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(54) Improved packet scheduling of real time information over a packet network 



(57) One method of processing first and second re- 
ceived packets of real-time information includes com- 
puting for each of said received packets respective 
deadline intervals and ordering processing of the first 
and second received packets according to the respec- 
tive deadline intervals. A single-chip integrated circuit 
has a processor circuit and embedded electronic in- 
structions forming an egress packet control establishing 
an egress scheduling list structure and operations in the 
processor circuit that extract a packet deadline intervals 
Dl, place packets in the egress scheduling list according 
to deadline intervals Dl; and embed a decoder that de- 
codes the packets according to a priority depending to 
their deadline intervals. Embedded electronic instruc- 
tions establish an egress scheduling list structure and 



operations in the processor circuit that establish channel 
decoders on non-coincident frame boundaries and a 
packet engine to detect when a first packet has a first 
deadline and is currently in decode while a second pack- 
et is just-arriving and has a second deadline earlier than 
the first deadline. The packet engine establishes a de- 
termination whether both the second and first packets 
can be decoded ahead of their respective deadlines if 
the second packet were decoded preemptively, and if 
so, then preempts the processorcircuit channel decoder 
structure to decode the second packet. Other process- 
es, integrated circuits, chipsets, wireless telephones, 
PBXs, line cards, computers : routers, and networks for 
voice over packet, media over packet and real-time 
transmissions over packet are disclosed. 
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Description 

Technical Field of The invention 

[0001 ] The present invention relates to the fields of integrated circuits, networking systems and processes for packet 
communications, and especially communication of real time information such as vo.ce, aud.o, .mages, v.deo and other 
real time information over packet. 

Background Of The Invention 

r0002] For every frame of compressed speech in a packet, loss of that packet means loss of each frame in that 
packet. There then arises the problem how to create 160 bits ormore of lost compressed speec. Reduction of packet 
loss and late packet handling strategy are very important challenges in advancing VOP technology. 
0003] Telephony represents a duplex channel. In the case of packet telephony one side (the mgress side) Receives 
voice or digitized voice (PCM data) and produces packets by using any of several compression processes. This ingress 
side is aSS completely "synchronous'. Voice is changed into frames. The size of the frames for a given data com- 

SET On the^erlL (the egress side) of packet telephony the packets are converted to PCM trames^which 
frames) are added to output buflers for each channel. The packets arrive at rate for which only the average .f known. 
TiTSSiC".* on the process used and thus on the frame size to be produced. The data from the output buffer 
is output at a constant rate. If not replenished in time, the data will run out. 

SUMMARY OF THE INVENTION 

[0005] in oneform of the invention, a method of processing first and second received packets of real -^^^ a ;;° n 
includes computing for each of said received packets respective deadline intervals and ordenng process.ng of the first 
and second received packets according to the respective deadline intervals. 
r00061 In yet another form of the invention, a single-chip circular time differencing ,,«♦„««, 
nteorated cLuit has a storage for values representative of the time of two events. An adder/subtractor coupled to the 
so ^S^mte. an electronic difference (delta) and delivers the difference value into the storage . thereby resulting 
a sign brt (S) and a most significant bit (MSB) of the difference value (delta). Logic c.rcuitry responds to he MSB and 
11 sign MS of the electronic difference (delta) and a predetermined value (TMAX), to drive the adder/subtractor to 
qenerate the circular time difference of the two events. „„^,„^ r Qn H a t 

[00071 in still another form of the invention, a wireless telephone includes an antenna, a voice transducer, and a 
eLt one integrated circuit assembly coupling the voice transducer to the antenna, and prov.d.ng voice over packet 
ranlrssioTs Lnd embedded elecLic instructions comprising an ingress/egress packet control that processes 
egresT n oration and determines lowest first egress deadline interval Dl and further executes an mgress prccess 
preempting the egress process when the value of lowest first egress deadline interval Dl exceeds a predeterm.ned 

toS'' Other forms of the invention encompass other processes, integrated circuits, chipsets line 
computer add-in cards, information storage articles, systems, computers, gateways, routers, cellular or other wireless 
telephone handsets, wireless base stations, appliances, and packet networks, and other forms as claimed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] The present invention will now be further described, by way of example, with reference to the preferred and 
exemplary embodiments illustrated in the figures of the accompanying drawings in which: 

FIG. 1 is a block diagram of an inventive process, integrated circuit, line card, system and packet communication 

RcT 2is a partially pictorial, partially block diagram of various inventive computers, wireless telephones, PBXs, 
automotive systems and networks, and FIG. 2 includes a magnified view of an inventive router implemented in 

Ras^apartiallyb^^ 

55 fax/scanners, and wireless telephones for communication with the Public Switched Telephone Network (PSTN) 

and a packet data network; . ^ ^ . ^ n M 

FIG. 4 is a partially pictorial, partially block diagram of inventive wireless telephones with network access and 

improved for enhanced packet communications; 
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FIG. 5 is a block diagram of an inventive process for software and one or more inventive integrated circuits for 
enhanced packet communications; 

FIG. 6 is a partially block, partially process diagram of inventive processes and one or more inventive integrated 
circuits for enhanced packet communications; 

FIG. 7 is a diagram of an example type of packet for use with the inventive processes, integrated circuits and 
systems herein; 

FIG. 8 is a diagram of inventive arrival, queuing, and processing operations wherein a horizontal axis represents 
time, and a vertical axis portrays various channels of a multi-channel packet communications system; 
FIG. 9 is a mostly block, partially channels versus time, diagram of an inventive egress processing system that 
processes communications packets arriving from a network; 

FIG. 1 0 is a diagram of arrival of packets in various communications channels having codecs operating on different 
frame lengths wherein a horizontal axis represents time, and a vertical axis portrays various channels of a multi- 
channel packet communications system; 

FIG. 11 is a block diagram of an inventive embodiment of buffers and decoder(s) for improved packet communi- 
cations; 

FIG. 12 is a graph of Usefulness versus a parameter X wherein the graph depicts operations and advantages of 
various inventive embodiments; 

FIG. 1 3 is a flow chart of inventive process steps based on packet deadlines; 

FIG. 14 is a flow chart of inventive process steps for handling information in various types of packets; 
FIGS. 15, 16. and 17 are diagrams of inventive and related data structures, records, and inventive updates proc- 
esses for use in inventive processes, integrated circuits, and systems; 

FIG. 18 is a block diagram of an inventive data structure for a queue having primary and secondary keys; 
FIG. 19 is a block diagram of an inventive system emphasizing interrupt structures; 

FIG. 20 is a chart of inventive embodiments according to interrupt or preemption policies wherein different embod- 
iment types are represented on different rows, and handling of differently timed packets is grouped in columns 
according to time of arrival of a packet; 

FIG 21 is a comparative timing diagram of two categories of inventive processes-Same-Deadline processes and 
Staggered Deadline Processes, wherein an example of a Staggered Deadline process is spread vertically and 
horizontally in a lower part of FIG. 21 ; 

FIG. 22 is a flowchart of an inventive Staggered Deadline Process; 
FIG. 23 is a flowchart of another inventive Staggered Deadline Process; 
FIG. 24 is a flowchart of yet another inventive Staggered Deadline Process; 
FIG. 25 is a flowchart of an inventive Break Process in the process of FIG. 24; 

FIG. 26 is a flowchart of an inventive process example of FIG. 20 Embodiment #5, upper left cell "Do Ingress First"; 
FIG. 27 is a block diagram of an alternative process to that of FIG. 14; 

FIG. 28 is a comparative time diagram of various cases of inventive process operations of converting linear time 
differences to circular time differences, for use in computing Deadline Intervals in other inventive processes herein; 
FIG. 29 is a flow chart ot-operations of in an inventive process for comparison with the time diagram of FIG. 28, 
wherein the process converts linear time differences to circular time differences; 

FIG. 30 is partially block diagram of a register, and partially graphical illustration of the various cases of FIG. 28 
wherein a variable of linear time difference Delta is used, and various operations of add and subtract (or neither) 
are employed; 

FIG. 31 is a partially block, partially pictorial diagram of an integrated circuit chip improved as described herein; 
FIG. 32 is a partially block, partially flowchart, diagram of operations corresponding to those of FIGS. 28-30 im- 
plemented in inventive hardware circuitry and process; 

FIG. 33 is a flowchart of inventive process embodiment that sorts new information into a queue and utilizes the 
circular time difference process of FIG. 29; 

FIG. 34 is a block diagram of an inventive system for image, video, speech, and audio improved packet commu- 
nications; 

FIG. 35 is a pictorial diagram of one embodiment of an inventive storage article of manufacture improved with 
physical variations establishing an inventive sequence queue process, and other inventive processes described 
herein; 

FIG. 36 is a pictorial diagram of another embodiment of an inventive storage article of manufacture having a disk 
drive, control sytem and system computer add-in card improved with physical variations and software establishing 
one or more inventive processes described herein; 

FIG. 37 is a block diagram of an inventive Internet appliance system improved with inventive processes and in- 
ventive integrated circuits as described herein; and 

FIG. 38 is a flowchart of an inventive process for handling gaps or holes in buffer reserves of data, when such 
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gaps or holes occur in operations of inventive integrated circuits and systems as described herein. 
^J^S™' C ° rreSPOndi ^ to corresponding parts and steps, except where the context 

5 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

[0011] FIG. 1 presents a view of packetized telephony Packets 112<5 a i c « cm ^ 

headers and their payloads of one or more comar^lTZ fZT ( ! ' G ' 7) com P nse bit streams with 

<° and RTCP (RTP Control Protocol) aadZe sZZ TnTJ T* RTP (Real Time Trans P ort p ^°col) 

of the network protocol .S^^^SS^S f3T T '° ^ PaCke,S ' au 9 menti "9 ». operations 
comprises 10, 20, 30 or 40 m!l lis^^^ M ^ C ° m P ression being applied, 

gannto d^ed voice data is ^Xll^-^ ^ ™ **» 

produce and receive digitized voice 9 9 (A ° C) and D ' 9lla ' t0 Anal0 9 < DAC ) converters, which 

Sor l^Z^T^ I^^^T^ T S ^ ' ^ ^ • ^ 
samp.es are numbers so re.a.ed in lime soZ whenThT, T by VertiCa ' ,ineS thereon - The 

1121. such as the Internet or ctherne^r t ! thelTan T 3 traf1SmiSSi ° n mediUm 

with data, then an interrupt is 9-^^^ W ^ 3 b ^ * 

signaled that it has a full buffer of data to process P processor 1115, and the processor is thereby 

LTcast^ 

packets 1125 that are suitab.y^ecod^^^^ 
*> may have created a page or buffered a data 3e wh 1 ' ' , * that * S ° me P ° int the com P u,er 11 *1 

of data ends the parent nan. ^^^ TZ™"* PreV, ° US frame is bein 9 out P ut - When the previous frame 
generated by computer °151 Suppose a packe 125 IE? * C ° RtinUity ° f thS ° UtpUt WaVeform 1161 bein 9 

filled with silence (or gap in the SJm o« J mL » ^ * C ° mpU,er 1151 ' Then the break is usually just 
[0016] The Ceniral Office on S ^^^ZST^'^ *** * ° f PreVi ° USly received ^ 
signed to support multiple lines. Using a dSTplS! tS^I 8 ' ^ , ^ UneCardS - EaCh is de " 

[0017] <n^.1,Hostproce S sor11lUh^ 

process provided therein to exchange information between me W ^nn Ihf / handshake host control 

host. The host controls what a given channel I ! doing 0r deStination connec ^ to the 

packets indicative of initiation of L call Tan inorHl ™ ' J"" ^ h ° St ° PenS 3 Channel and sends signaling 
to a destination. In an ingress 3S on pro^esT he ^hT" rf"' ^ h ° St th6n SGndS V ° iCe data P acke * 

-aieS^^^ 

another computer indicative^ initiation of S ^ " e hosMlT- P3CketS from 

other things, a channel number is H^inn^H to. 1115 ,nteracts with the DSP so that, amonq 
identifier Sored into the^eJs ^ fS' U^S Tn thT' 6 '° ^ — ^ ^ 

the channel for the host and the DSP to use and stm. nrf t W8y the ° hannel record characterizes 

*> channel is disconnected. ' tmCtUreS the °P eratl ° ns <* the DSP relative to that channe. until the 

UsZ: ^^Z^^^£:^ 5 — - «*- data packets from the other computer 
that channe. over which the voice dS^cSl?,! !l2 n *! "T" T™™ thS egreSS channel reco ' d 141 3 ^ 
munications process that knpn^^.^^^ pT^^ ^ ^ ^ ^ 
ro" 2 1 f l P Tn k t e h tS W ° U,d ° therWiSe 66 ' 0St to a P-Ss hl^ ' 1 ^ PrOV ' ded ' S ° 38 t0 make 
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[0022] 32 channel management system combined with a 32 channel decoder on the egress side. Note that the 
decoder is simply a program, and the computer has a set of, for example, five decoder programs implemented five 
corresponding decode processes of which one might be G.723. A given one of the decoder programs services all of 
the channels that call for its decode process in block 1 41 3, channel by channel. Block 1 41 3 determines which decoder 
5 is assigned to which channel AH 32 channels may use the same decoder. Or 5 channels might use decoder 1,12 
channels use decooer 2 9 channels use decoder 3, 2 channels use decoder 4, and 4 channels use decoder 5, for 
another example 

[0023] Many but no: ail emoodiments have a decoder as in FIG. 1 in the same device, system, or process at a given 
node of implementation However still other embodiments have the decoder physically located remotely, over a syn- 

io chronous network c c:r>e'*;sc irom the packet shuffling or sorting process site of FIG. 2A. At the network level, the 
network 200 of FiG :' ccn.sii! jtcs * system wherein each packet has its own hard deadline. Many packets are channeled 
into a node or route ic rj 1 33 1 m the network 200 to be sent out in order of priority by a packet scheduling manager 
of FIG. 2A, If it is kno*- * #> c^ ine speech begins, then it is known exactly when the packet is needed utilizing a channel 
delay database 1 1 *v t* e « ystcrr is extended and arranged to make the process all remote, wherein the router 

15 and packet schecu^'; ^w.,* >?• c? ► iG ?A is provided with a process that decides how to send out packets like 1125 
from buffer 1163 to ** >v ' «" noaos away. Thus, a buffer selector 1175 coupled to an issuer 11 65 decides 
when to send vancx-, ; ^ • Gw f AST from the router out to destination nodes. In this way, packets that 
would otherwise anv, i. .«:*■ :*o v-s ^ntion decoder 171 are in fact advanced and issued by issuer block 1165 
in the routing process ^ v **« i''»o for use at the decoder 171 at the end of the path. 

20 [0024] FIG. 2 snow:. * ^k>^i ;*-:>o coupling computers 203 and 205. If one path from a source 203 is inter- 

mittent, then another fx:*' w t: l-c p'esent so that packets can get to the destination 205. The source 203 

inventively launches p,w*c'% aer-eoacnt packets one or more paths through network 200. In the Internet the 

path that a given paoc t,i*c cm^oi ^:.«**ity be predicted, and various packets will take different routes due to the 
fault-tolerant, multiple p**^ n.i-^f _* o i^c Werner A PC or workstation is provided at destination 205 to receive streams 

25 of data such as from tnic^'v-*.*:.? n^x?t ?3i and 233. 

[0025] Further in FiG ^cvon^i computer 203 has a microphone 261.1, a loudspeaker (and/or headphones or 
other audio transducer) rt^' i * • eyt>OH' 3 <an<i'or mouse or other touch-sensitive input device) 263.1 , a computer box 
264.1 including one or more tr^'m^jjnn Mor H go devices 265.1 and a printed wiring board 266.1 with microprocessor 
(s), digital signal processor m voi,-ue rrv-mory peripheral chipset and peripherals. Associated with computer box 

30 264.1 is a cathode ray tube r?x>^*to* i^ io' iicuid crystal display, and/or digital light processor (DLP™ Technology from 
Texas Instruments Incorporated nndoi other display device and/or printer) 267.1 coupled to printed wiring board 
266.1. Other peripherals (not s^c^rj sjet as videoconferencing camera, digital still camera, optical scanner, electro- 
cardiograph EKG, wire/po*o< »mc cat>tc/f tocr networking interfaces, wireless networking interface and other devices 
now available or yet to be devised arc also coupled to printed wiring board 266.1 . A modem 268.1 is also coupled to 

35 printed wiring board 261 .1 Thcmoccfr is suitably V.90 voice-band modem, cable modem, DSL (digital subscriber tine 
modem), ISDN (Integratcc Sc^vccs Digital Network) or other suitable modem. The modem 268.1 couples personal 
computer 203 to a packet network gateway computer 271 as well as to a public switched telephone network PSTN 285. 
[0026] A similar description nppi.es to v-*nous components associated with computer 205 of FIG. 2, and reference 
numerals with a suffix " i" have ii*e description of corresponding reference numerals already described in connection 

^0 with personal computer 203 Also mc sufh* " i" indicates that computer 205 is one of many computers coupled to packet 
network 200 and or via PSTN 28S to a gateway to network 200. 

[0027] Further in FIG. 2. a coti phone 281 typifies numerous cell phones active in a cell of a cellular telephone base 
station 283. Cell phone 281 has enclosure with a manual input (or touch pad or button pad or keyboard) 281 .1 , a 
microphone 281 .4, an audio cutout transducer such as a loudspeaker 281 .5, a visual interface 281 .3 such as an LCD 

is screen, and a wireless antenna 281 7 inside of cellular telephone 281 is electronics coupled to the aforementioned 
components, and the electrorics includes an analog section coupling the microphone 281 .4 and speaker 281 .5 to an 
integrated circuit assembly including TMS320C54xx and/or TMS320C55xx DSP from Texas Instruments Incorporated 
and a microcontroller such as an ARM (TM) chip licensed by Advanced RISC Machines. The microcontroller is also 
coupled to the manual input 281 1 and visual interface 281 .3. Further, the microcontroller is coupled with the digital 

50 signal processor. A radio frequency RF section couples the other sections and chips to the antenna 281 .7 for two-way 
and multi-way communications 

[0028] Base stations 283 and 287 arc coupled to a public switched telephone network PSTN 285, which in turn is 
coupled to the packet network 200 Also, base stations 283 and 287 are respectively coupled to packet network 200 
via gateways 291 and 293. In the cell served by base station 287, a cell phone 289 typifies numerous cell phones 
55 active in a ceil service area of that base station 287. 

[0029] A private branch exchange PBX 202 couples telephones 204 and 206 to PSTN 285. Suitably, PBX 202 is. 
improved for path diversity communications as described herein. Another PBX 211 couples IP phones 213 and 215 to 
a node of packet network 200 as illustrated. 
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l 3S3\^t Vari ° US ° f ,h6 im ? rovements ascribed herein are suitably partitioned between the DSPs 351 
353,. ..355 and the microcontroller (MCU) 381 and stored on-chio anrt in th* n n~L- uneuDetweentneufaPs 351, 

[0033] Soriwa,, ,s d^closeO nerein « also impten.nted in or loaded Into compulors shown in FIG 2 li«. Ma „„,, 

= ™ 95 „e,„o,„d^^^ 

= ™, 6 * «,P o, VoIP „„ r ,„. paete , no^^olt^p 1 s™ les 287 ,h " S 

::sr!pTrr a ™^ 

contemplated here the voice is recodort t™ th. ™3 c hen accord,n 9to improvements . 

equipment to improved glew^^^^^ Ae' T "IT™* * °' RGS - 5 and 6 C0U P |e their 

an add-in p^Wb£ST«S S^r^^^S^^ F ^-^-~.- 

as dozens, hundreds or thousands of simultaneous calls the software afFIGiS 5 ZTk h hlS T ^ 
mented in gateways 191 and 193 and such PBX« ic * are ° f FIGS ' 5 and 6 and elsewhere herein imple- 

tichannel service. and 6 f ° r occaslonal supervisory monitoring and control of the mul- 

[00411 In RG. 5. a packet voice digital signal processor (DSP) 511 is imp.emented as an integrated circuit with 



6 



EP 1 137 226 A2 



embedded software establishing blocks as shown. The integrated circuit is suitably a CMOS DSP such as any suitable 
selection from the TMS320C54x, TMS320C55x or TSM320C6x DSP families, or other such families commercially 
available from Texas Instruments Incorporated, Dallas, Texas USA. 

[0042] For example, the TMS320C54x fixed-point, DSP family is fabricated with a combination of an advanced mod- 
5 jfied Harvard architecture which has one program memory bus and three data memory buses. This processor also 
provides a central arithmetic logic unit which has a high degree of parallelism and application-specific hardware logic, 
or -chip memory, additional on-chip peripherals. This DSP provides a specialized instruction set for operational flexibility 
ard speed of the DSP. 

[0043] Separate program and data spaces allow simultaneous access to program instructions and data. Two reads 

10 ard one write operation can be performed in a single cycle. Instructions with parallel store and application-specific 
instructions arc provided. Data can be transferred between data and program spaces. The parallelism supports a 
pewcrfu set of arithmetic, logic and bit-manipulation operations that can all be performed in a single machine cycle. 
Control mechanisms manage interrupts, repeated operations and function calling. On-chip RAM and ROM memories 
arc provided Peripherals on-chip include serial port and HPI host port interface. 

'5 [0044] In HG 5. integrated circuit 511 is improved with software manufactured into the ROM, or other nonvolatile, 
memory lor implementing some part of the process embodiments. Thus, FIG. 5 emphasizes an example of software 
blocks manufactured into the integrated circuit 511, the hardware described hereinabove being understood. Thus, 
oesenpt on in software parlance follows next regarding FIG. 5 wherein for example a "unit" refers primarily to a block 
of so'twarc alihough a hardware block is another suitable alternative. 

20 [0045] In FIG 5. voice samples are supplied from an analog to digital converter (ADC) not shown, to a PCM interface 
51 5 and converted there to pulse code modulation. Next the PCM is fed to an Echo Canceller block 517, which feeds 
a Gam Control block 521 . Gain control 521 supplies a Voice Activity Detector 531 which detects whether voice packets 
or stioncc packets are to be generated. The output of Voice Activity Detector 531 goes to a speech coder 541 having 
a Voce Coding Unit, or encoder 551 . The speech coder 541 is suitably devised or implemented by the skilled worker 

£5 sc as to nave multiple coding rate modes as contemplated herein. For one example, G.729 and Annexes with 1 1 .8kbps, 
8kbps and 6 4<bps selectable source rates sij is suitably used. Then an Ingress/Egress Control Block 581 couples the 
OLtput o> encoder 551 to a Packet Encapsulation Unit 571 which thereupon outputs voice packets from the DSP. Control 
Block 581 also feeds control signals between itself to voice coding unit 551 to accomplish functions as described herein. 
[0046] On a receive path in FIG. 5 voice packets enter packet encapsulation unit 571 where they are depacketized 

30 ard passed to the Ingress/Egress Control Unit 581 . Control Unit 581 has software that implements process steps for 
ordering processing and saving packets which would be lost by conventional techniques. 

[0047] The destination is suitably improved with an integrated circuit 51V (not shown) similar to or identical to inte- 
grated circuit 511 of FIG. 5. 

[0048] From Packet Playout Control Unit 581 . depacketized compressed voice information being received is then 
35 stppiied in a controlled manner to a speech decoder 555 portion of speech coder 541. Silence packets and voice 
packets, suitably dejittered and compensated by use of diversity packets as improved according to any of various 
process embodiments herein, then are decoded by speech decoder 555 and thus played out. The speech thus played 
out. passes via Gain Control 521 to PCM interface and from there to a DAC (digital to analog converter) not shown 
which can be provided either on-chip or off-chip as the skilled worker elects. The PCM output as converted by the DAC 
-to thus reconstitutes the voice in an advantageous manner more fully satisfactory and enjoyable to the user, by virtue of 
the various improvements provided and discussed herein. Further, a DTMF "touch-tone" generator 591 and Tone De- 
tector 593 handle the dialing steps for placing a VOPA/oiP telephone call to confer a comprehensive application im- 
proved as discussed herein. 

[0049] In FIG. 6. the improvements are illustratively partitioned so that the RTCP is associated with MCU 381 of FIG. 
•*s 3. The ingress/egress control block 581 and other FIG. 5 blocks are suitably provided in the DSP software complement 
for the DSPs of FIG. 3. 

[0050] In FIG. 6. MCU 381 of FIG. 3 is provided with a TCP/UDP/IP stack 61 1 which further has MAC/A RP, Ethernet 
driver and other network interface protocol blocks. Further, network management software 615 for MCU 381 has a 
network management agent controlling and interfacing to a first software block for embedded webserver HTTP (Hy- 

50 pertext Transfer Protocol) and Java applications, a second software block for SNMP protocol, Voice Ml Bs, and Protocol 
MIBs : and a third software block for TFTP software download. Still further, telephone signaling gateway software for 
MCU 381 has call processing software, address translation and parsing software, and H.323 protocols including H. 
225 signaling, H .245 software, and RAS/RTCP software. The RTCP function in block 61 9 is coupled to the UDP function 
in TCP/UDP/IP stack 611 and also coupled to the Packet Encapsulation unit in DSP 511 of FIG. 5. 

55 [0051 ] A DSP interface manager software block 621 is coupled to software blocks 611,615,619 and 623 and com- 
municates with DSP 511 of FIG. 5 and the software blocks described in connection therewith. 

[0052] MCU 381 runs system software 623 including RTOS (real time operating system such as Microsoft Windows 
CE or Symbian EPOC, as well as DSP 51 1 running BIOS™ RTOS from Texas Instruments Inc.) System software 623 
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f ' aSh BSP ■ d — - «- —st (IPQST) software, 

have 1 00,000 (one hundred thousand) lines for haSna 0 000 ?f„ fh ^ ' " te ' 6Ph0ne C6ntral office can 
merous DSPs and line cards are use I n a^honi Srl?'^ Ph ° ne Ca " S concur ™tly Thus, nu- 

porated, Dallas, Texas, provides ^Z^ZZZI ' ^ ^ ^ ,nStmmen,S ,neor " 

future. The queue 151 of paX s pa rt of ^fZ^SZZf - 'I ° f W "* »* '° " ™ 
separates the past from the future 9 amv - m9 packets model a,on 9 the line, which 

[0056, Looking a, the buffeS^ 

Jhe two addresses there is data read, 

S noldt of U cari h ln e e r mmUniCati ° n " * " thS " der " ^ <* ^ is made to depend 
[0059] Quantitatively, the reserve is the difference of two addresses: 
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25 



30 



R = bf out -w jr 



~^im^^ ! data — * «» — *™ consider 

of time units C A in that region are the same Th s C R 9 ^ *°* iS the Samp ' ing C,0ck ' lhe 

[0061] <="^ - ■ 5»^ A -"A- 



35 



40 



— ^^^^^ 

withdrawn from the memory, aN Si ^shLed fol 5?! ™ " *" EaCh time a data ele ™* * 

existing data. remdln,n9 data ,s shlfted f °™ard. When data is added, it is appended to the end of 

the NOW, one sample at a time at 8kHz rate 9 r6Se,VeS 3re consumed by "moving" toward 

Se oTa G 1 O^IT " ?» ^ »« *«*" - U frames is a 

Notice on FIG. 1 .4 that "NOW" for 7cha!neS!s alt th ^rf 0 "** * ^ ° f the 1 ° msec boundaries. 
10msec period, thus the same number of samptes " by the Same fracti °" * the 

« - - the frame, in consequence (inspect FK, 

fail on one of the 1 0msec boundaries In conseauen,, , h T , ^ imP "' eS th3t dead,ines for anv P ac ** also 
sing,e sa mp ,e (1 2 5usec) to Z^pJ^ZET 1100 " meaSUrementS Ca " be lowered '™ a 

P ro"l.lnrraT^^^ 
*» 10 msec or 80 samples worth of data Both The L.t T T Pr ° CeSS6S a " h3Ve 3 9reatest comm ° n divi *°' of 
common 10 msec boundary Vrame tas o aili , iT " 0UtPUt SamP ' ed ^ frameS are ali 9 ned alon 9 ^ 
channel. * t8Sk ' ° r S ' mply task means the CPU activity on behalf of one frame for one 
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Maximum delay in absence of preemption 
[0066] 
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encode upper limits are determined. 

[0067] In one set of embodiments, illustrated in FIG. 1 1 an architecture saves moderately-late-arriving packets which 
would be effectively lost to the system if processed in order. The solution advances processing of the packets depending 
on their deadline. This type of embodiment is useful for instance in infrastructure systems where one or more real time 

5 decoders 1171 process many media channels serviced by many parallel buffers 11 75. a, 1175.b, 1175.c,...11 75. q that 
are receiving packets concurrently. A packet buffer 1181 receives packets for the many channels. If the packets were 
processed on a first-in-first-out basis from buffer 1181 , holding packets C.A.B.C^B.Q.BAA. var j OUS late-arriving pack- 
ets C,A : B would be useless to the system because they would be processed too late. A selector 1185 operates ac- 
cording to a process that advances processing of a packet C, for example, where channel buffer 1175.C is almost 

10 empty, by moving packet C "to the head of the line" that is, by moving packet C from the tail end buffer 1181 to the 
almost-empty channel buffer 11 75.c. Thus, the late packet C is made available to decoder(s) 1171 soon enough to be 
useful, or even just in time, advantageously improving the operations of the system. 

REMOVING FIRST DATA PACKET DEPENDENCY IN A CHANNEL 

15 

[0068] Returning to FIG. 11 , a possible problem in VoIP is that the decoder output begins and depends on the cir- 
cumstances of the arrival of the very first packet of the compressed speech. This phenomenon is called first packet 
dependency herein. Depending on the accident of the arrival delay of that first packet relative to the succeeding packet 
(s) the process may propagate this accident in an unfortunate way and degrade the reception performance for all the 

20 rest of the packets. To solve this problem, a buffer 1171 is used to accumulate some packets. The decode system 1511 
is made intelligent enough to delay the egress output of the first packet, thereby advantageously reserving a cushion 
of time for subsequent packets before their deadline expires. In this way, late arriving packets that arrive, for example, 
40ms late still have 20ms of grace, thanks to the provision of the 60ms buffering of the very first packet. 
[0069] This buffering time is chosen long enough to provide effective deadline cushioning, and short enough to not 

25 unacceptably contribute to delay in conversational speech that might be noticed by the users before they can hear 
reply speech. 

[0070] In this way, the improved decode system, device and process ameliorates the sensitivity of VolPA/oP/media 
system to accidents in arrival delay of the very first packet in a channel. By contrast a conventional anti-jitter buffer 
merely evens out the variations in delay between successive packets in the communications stream. Buffer 1171 is a 
30 both single-channel and multiple-channel improvement. 

[0071] Alternatively, the first packet is simply placed back a number of spaces in its channel buffer of FIG. 11 . This 
result is advantageously accomplished by suitably programming selector software or configuring buffer hardware. 
[0072] In other embodiments, the packet buffer has a.sophisticated selector process 1 1 85 and distinct channel buffers 
1175.a-.q are unnecessary. 

35 [0073] The graph of FIG. 12 is illustrated as stairsteps, when time available for decode permits (right to left) at first 
only one full frame per channel of decode, then 2 frames of decode, then 3 frames of decode, etc., in the time available. 
The graph of FIG. 1 2 recognizes that sequencing the latest very late packet to the head of a sequencing queue becomes 
ever more critical the more execute time a frame needs for decoding, compared to the execute time the system can 
make available. The time available for decode graph of FIG. 1 2 is net of time needed by the system to perform ingress 

40 and overhead processing, which is estimated elsewhere herein. As discussed here, embodiments of sequencing ad- 
vantageously provide the most advantage in the most demanding of short frame intervals, all channels active and lower 
performances (less expensive) DSPs. 

[0074] In FIG. 13 for egress method, operations begin at Egress 1200 with an arriving packet reception step 1211. 
The system has an organization of channel records egr_chnl_rec used by a step 1213. The channel number points to 

45 a corresponding channel record. Step 1213 extracts the packet deadline for a given packet and updates the organization 
of channel records egr_chnl_rec. The channel record contains a deadline value, which is a number that RAS (remote 
access switching) design specifies a number of 10 millisecond (ms) units to which the packet is subject before it be- 
comes useless and may be thrown away. Next, a step 1215 places a packet of data in an egress scheduling list 
egr_sched_list according to the packet deadline value. Later, a step 121 7 updates the channel record egr_chnl _rec. 

50 This update step 1217 is performed suitably on 1 0 millisecond boundaries ( or otherwise periodically) or alternatively 
performed on some regular basis whether periodic, non-periodic determinate, or non-periodic random. 
[0075] Consider a voice stream of conversational voice. Interspersed with the voice are various spaces of silence. 
When the computer receives the packets and converts them into voice, some packets may be too late or lost and have 
to be replaced with silence with decay, noise, or interpolated data. In the case of silence, just before the D/A conversion, 

55 time constants of rise time and decay may be used. Thus : in process control systems, which might otherwise respond 
to silence very violently (e.g. pressure expected to be 25psi is found to be zero), "silence" or "zero" frames are handled 
in a way that provides appropriate rise and decay respective to the system application. 

[0076] In the voice area, the silence frame or silence packet contains an amount of time of the silence, or can be 
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sent packet by packet. 

[0077] When the silence packet enters the queue, a process embodiment here bypasses the decode orocess and 
go dwcuy to the output side of the decoder, and make a period of silence. If a silence packet arrived fEETi ^ 
stools Th ? U6U r S 3 V ° iCe f PaCk6t W0U ' d be ' " * he manner diScussed earlier hereinabovrrSnnio wth 
process ' " " bSin9 * V ° te ° PM °' 3 SilSnCe PaCk6t Suitab, V is introduced imome 

[0078] In FIG 14, a Sequence Queue and Management block receives a voice packet 1 409. A silence packet detector 
or selector 405 routes voice packets such as 1409 to block 1431 . The selector 1405 routes sIen« pSS*2^ 
s.icncc packet 1 407 to a post-processing block 1441 . An example of postprocessing generates voice Sate d ^tlv intn 

areciy .o output buffer 1451. thus to f.ll certain spaces in the output buffer with data corresponding to silence in a 
manner consistent with the method used to represent silence in the system. The silence processing byp^ses the 
queue bloc. 143 The postprocessing updates the channel records 1413 and increases the delay b thTnumbe o' 
m "'seconds of s..once. thus acting as a source of maintenance of egr chnl records 1413 

^l" P ack f e, , iS fo,lowed b V consecutive voice packets, then according to schedule update in .ink 

usi : 14ji. ,i ib 0 mnnseconds of silence occur, the voice packets are scheduled-in channel record 1413 The post proc 
cssor simpy updates by addition. If the frame is 4 units wide then the silence record (representing a frLe 4 units 
wide : chusc. an update of an entry of 3 in channel record by adding 4 to 3 to equal 7. This then is to£2£t£Z 
S „ V , C ' CC P T? th Furth h erni0re ' if lhe silence P acke < - - a type that identifies plural frames of silence by a 
T, I , J ^ 6t ' ,h6n Update iS 6qUal t0 the cnannel record P lu * 4S- (For example 4S + 3 is the new 
updated deadline .ntorval value in the channel record.) Of course, if another type of packet represents a difference 
wd,h r. the number 4 is repiaced with that frame width. ,„ genera, the proems updates a va'Le o Dl by ST 



Dl = Dl + S x F. 



d„,a and deeding whether s-.ence or voice may invo.ve 50-1 00 instructions, and these are concisely representee as 

ZoZT^ " EST 1405 diam ° nd A V ° iCe ^ 1409 9 ° es to the 1431 • -entually gets s" t to voic" 

decoder processing 1425, goes to post processing and decoded voice gets into the buffer 1451 and postprocessing 

ItlLT nJ. ; a " ne ' : eC ° rd U13 - Post P^ssing updates the deadline interval Dl or deadNn iSStT n 
channel record 1413. Oead.me interval whose example is 3 in channel record 1413 is updated by postprocessing M441 

[0081] Decoding process 1 425 provides digitized decoded voice to local buffer 1 461 and sirm- 1« ™e, 

1441 which thereupon or concurrently does maintenance of the deadline ^^2"^^^^ 

S °F 9 inlaTo ? Win9 T nUmb6r ° f framSS S ,hat thS Sl,enCe packet -presents r^^h. 
length F mdicated by example numeral 4 in channel record 1413 whereupon the product is added to the deadZ 

K25 ho o e h : sst isr* or r e - initiates a ,ocai buffer 1 461 to store ^z^* 

buffer us n lT^n „ J ' P ° S,pr0CeSsln 9 1441 causes « silence word 1465 to be transferred to the output 
buffer 1451 in the one or more number frames indicated to be silence by the silence packet If there is a voice oacket 
the postprocessmg 1441 causes the loca, buffer 1461 to issue a voice datum into the output Sfe 145° tc take fts 
place in the queue ol that output buffer 1451. H 10 laKe ,ts 

[0082] Next consider the processing of a succession of silence packet, voice packet silence packet voice oacket 
s^nceTgna? 1 " 5 * ^ ^ ««• °"< the output buffer 1451 Xzer^^^ther 

fn,!!!]../ 1 '',"" 1 !, 1 ?/ 13 1 5 ' a r6COrd eQreSS Channel reCords 1413 has an exar "P'e number "3" (with leqend "deadline 
numbe T"H er mdiCatinS * 3 ten - millis ^ 'Nervals remaining before it becomes useless This 

ZVL ir h<i m", t! *? StrUCtUrS e 9 r - chn, - rec is a " wtry e gr_in_use variable. The variable entry is "in use » so 
TJa ZZ n l Y J I Channe ' beC0m6S " in USe " durin9 a P eriod when the channel was free (entryTs ze o Stand 

^t^^^TT^^ ,hen a 9iven channel is assigned t0 that ca " and then the " in ™ 

uses the Z ^ wante9eou * | y- when the P racess canning many (e.g., 32) channel records, the system processing 
uses the egr_m use variable to avoid processing those channels that are not in use since there is no need to do anv 
processing on them. In a machine that can process 32 channels, such as 32 telephone cal.s. ff at a giv^ t me on J 
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ten telephone calls need be processed, then only ten of the channel records would hav a one (1 ) entry in egr_in_use. 
[0085] The next entry number (for example, shown as "4") is data frame size F in units of 10ms intervals, and is 
process dependent. This is not the packet length, but instead the length of a frame of compressed data, of which one 
or more frames are carried in the payload of a packet received in step 1211 in FIG. 13 and a packet 1125 in FIG. 1 . 

5 [0086] Beginning with raw data on the ingress side, a certain amount 40ms. of PCM data is compressed into a packet 
by an encode process. Usually, but not always, the packet changes the amount of data from 320 words to perhaps as 
few as 20 words (16:1 compression). If the channels are very congested, the system suitably chooses a different 
compression process that compresses a fewer number of words, say 160, to 20 words (8:1 compression). Pure voice 
1111 of FIG. 2 in digitized form is encoded into packets that are sent into the network 1121. One encoder process 

10 produces a frame 40ms long. Another encoder process takes 160 words equivalent to 20ms which also produces about 
20 words for packets. Thus a frame is that interval of uncompressed digitized speech which an encoder process takes 
as its basic unit of compression. 

[0087] A "frame task" for the ingress process is a task to take a frame for the encode process and produce a packet. 
The encode process depends on the sending computer process. For a telephone call, the encode process used by 
* 5 computer 1 1 01 to send to computer 1151 may be a different encode process used by computer 11 51 to send to computer 
1101. 

[0088] On the egress side, a frame task is the inverse process of decoding a packet or frame into decompressed or 
decoded real time data. On the egress side, a frame task is the processing required to reproduce from a single packet 
of data the frame which was intended to be reconstructed. 

20 [0089] Among about a dozen popular international standard codec processes, choose which of the processes to use 
for a given transmission (or switch between or recode processes in a single transmission). Suppose, among 30 active 
channels on an egress side, some of the channels use process A using 40ms frame size, others use a GPS process 
using 30ms frame size, still others use frame size 20ms-so that the system at any moment is processing a mix of 
processes. Note in FIGS. 14 and 15 in channel record 1413 having deadline numeral 3 for 30ms, that this counts clock 

25 time. Instead it is the numeral 4 that represents the 40ms frame size corresponding to a given 40ms process as just 
discussed. 

[0090] A reserved space for a finer resolution is marked with a star (*) in block 1413 of FIG. 15. 

[0091] A queue 1431 holds all the channel records. The system has the deadline information indicating by when 

each packet has to be executed. The system copies the deadline interval entry "3" in block 1413 and associates it with 

30 its corresponding packet. The queue is a link list 1 431 in FIG. 1 6, designated egr_sched_cell comprised of linked cells. 
Each cell in the structure egr_sched_cell is a cell of three words that has a pointer to a packet and has a deadline for 
when that packet needs to be executed, and finally has a pointer to the next egress schedule cell in the queue, thus 
ordering the cells in order of their deadlines. The order of the cells represents the order in which the process is arranged 
to execute the decode process on the frame contents of the corresponding packets. Also note that the whole queue 

35 js advantageously updated every 1 0ms. Thus, at 1 0ms intervals a decrement process goes accesses every cell in the 
queue 1431 and decrements the deadline numbers by one (1 , representing 10ms). 

[0092] Every cell that has a deadline of zero or a negative number after the decrementing process, or upon arrival, 
is thrown away from the queue 1 431 . The output bufferto the decoder has the corresponding head-end entry left blank 
or zeroed out, whereupon the decoder performs its native response to the absent frame. 

[0093] Thus, each cell in the que egr_sched_cell points to a packet that still needs to go through the decode process 
and provides the deadline for the packet. 

[0094] In FIG. 15, note further that the structure 1413 egr_chnl_records may not have the deadlines in same order 
as ABC in queue 1431 egr_sched_cell of FIG. 16. When a data packet 1511 arrives in FIG. 15, the process first 
associates the packet with an empty cell 1 541 (called N). The software process first assigns in cell 1 541 a pointer 1 545 
45 to the data packet 1511 and thereafter the data packet 1511 need not be moved, and only the egress schedule list 
(queue 1431) cells of FIG. 16 are relinked as the process proceeds. 

[0095] In FIGS. 15 and 17, note that the letter N does not necessarily indicate that the cell 1541 will become the last 
cell in the queue. Instead the cell 1541 is inserted in the following manner into the queue 1431 in a place ordinally 
established by its deadline value "3." Once the pointer 1545 has been established, the process reads, recovers or 

50 calculates the deadline value 3 from the packet 1 511 and plugs the deadline value "3" into the middle place in the new 
cell 1541 as illustrated in FIG. 15. Next, the process goes to the egress schedule list queue 1431 egr_sched_cell of 
FIG. 16 to establish such a place (see FIG. 17) for the cell 1541 in the queue 1431 (and thus indirectly for the packet 
as well) that the deadlines above will be shorter, and the deadlines below will be longer, thereby advantageously 
establishing, maintaining and updating list 1431 as an ordered list queue. 

55 [0096] In FIG. 16 queue 1431 represents the cell scheduling list at a time befor update with the latest cell as in FIG 
17. The list 1751 is the egress scheduling list 1431 after having been updated with the Nth record 1541 , except that 
cell 1541 has had its last (3 rd ) word arranged to point to cell C in old list 1431 , and record B of cell list 1431 has had 
its 3 rd word updated to point to the cell N just added. In the software the 3 rd word is called NEXT. The deadline of cell 
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B is less than the deadline of the new cell N, so the new packet 1 51 1 can wait longer than B, and when the deadline 
^^JTclV^^ ,6SS ^ ° r 6qUal 10 *" ° f - C *™ - -w ce„ N is sandwiched h " 222 

Ur^St m^L Pr ° CeSS perf ° rmS a linked sort according to any of several methods. In a one method, cells and packets 
I L a T? In mem °^ ° r ° ther St ° rage - ' nStead ' the me,hod sim P'V "P*** the pointers to keep the tei ordered 
to Z Z » amVe T COrresp0ndin 9 new ce,,s 9et added to the list. Further the method updates the N EXT pointers 
to drop old cells as packets get decoded or go past their deadline. An alternative method physically relocated 6a s Un 
storage under software control to keep it in a particular order. In a further alternative method, Z^lToZZw 
accomp shes the reordering and maintenance of the queue. Lookup tabie maintenance routines in rTm on a DSP 
various kinds of table sorts and other methods are also contemplated 

S? 8 Irr« a ni Ca H ly ' "! embodimen,s 38 the ne w P^«ets come in they are entered into a deadline-order list or 

T^Zr!TT nQ Sm ent6red ,nt ° 8 deadlirie -o^ered queue, or they are otherwise reordered, main Lined 
deales m " m3nner reSP ° nSiVe t0 ^ ^ ° f th6 ' r deadNne inf ° rmation " othefW ^ as a function JfZr 
tHL ♦« , RG J 6 ' mai " tenance of thescheduling list 1 431 involves two distinct processes. A first process decrements 
ZVZnrJ 6 by ° n6 ' 6Very time 10ms passes ' This first P rocess * initiated by a 10ms 

hu onp» Th Pr ° C f K, 9 ° eS thr ° U9h thS qU6Ue f0 "° Wing the NEXT P° inters and decrementing every cell deadline eX 

S^oinlH an a] TTT IT ° f qUeUin9 Pr0C6SS f ° r handlin9 the last ce " in the aueue . a ^ader has two pointers 
oroces^ ZeZ tn° T,^ C6 " °' the qU6Ue ' and ,he second pointer P°*«t» «° the las, cell of the queue ^ e 
ZTZ t k ' 0Wm9 thS NEXT P ° interS and alSO sparing each successive NEXT pointer with the 

second pomter ,n the header. When the NEXT pointer equals the second pointer in the header then theTasTce is 
processed, and the update process terminates. ' ,s 

alrlL.T T Para9raphs above ' u P datin 9 the q^ue involves two distinct processes. The second of the 

h o^ iir, S T qUSUe ^ inC ' USi0n ° f 3 new| y- arri ved Packet 1511 from which a deadline was extracted for 

?S? wlf ,1' h T \ Pr °T S accomp,ished this b y 90^9 through the queue comparing the deadline of new ce! 

sonJ ! de?d£T 7 S H Ch A ' B ' C a ' ready ° n thS ,iSt The process suitabl V as — that the list is aTeaot 
sorted ,n dead! ne order, and then wntes into the NEXT field of the new cell 1541 only when the deadlines hiqheri^ 

E «S H^nr™ % an deadMne " 3 " in n6W Ce " 1541 and the deadlines lower in IW are gre* than TequL" 
mini, T? e , I'" T Ce " 1541 ' n thiS Way the new ce " 1 541 is " inserted " '"to the list 1431 q 
£ V2L i„ «°f ' S ° me dead ' ineS Wi " be 6qUal f ° r diStinct packets ' 80 that t^ °rder of these distinct packets 

Lflt 9 T qU6Ue f may n0t mat,er ' and th6y are Suitab 'y lis,ed ^ther in the larger queue Altema^aS 
advantageously, layers of priority are introduced in addition to the deadline priority layerjust described Sexamole 

size, Decause losing a 40ms frame is more serious than losing a 10ms frame 

[0103] The identity of the caller (by company, by organizational position, telephone operator by name or bv service 
eature such as call wait.ng) is suitab.y introduced as a third layer of priority, thereby to put the LTw'h deadL 3» 
nrinT T ? qU ! UG re ' atiVe t0 ° ther Ce " S naving the same deadline "3" in accordance wfth this thS layer of 

mm Te ZlZl r PermUta,i ° nS ° f Pr0C6SS Can bS US6d t0 the put the cells a desired rd 7 

[0104] The foregoing cons.derat.ons suggest a rule, or further dimensions of ordering the queue 1431 intheoartof 
the process that orders the queue in a second key of ordering ' P 

SIS £" ° f PaCk . StS in the qU6Ue e 9 r - sch ed_cell are assumed to be in the same channel. 
[0106] Somet.mes, the packets from the same channel arrive in the wrong order This is handled bv reordPrinn 
accordmg to UDP (Universal Datagram Protocol) sequence number in the header «^Jt£^j£7« 
packets are com,ng out of order, then the process determines the (large) number of milliseconds for a IZ elrW- 
arnvmg packet and creates a new cell 1541 that wil. be rather low in the queue. When a subsequent ou of orde7 P acket 

ce! flrthJ ^,1 V COrresponds ' and that new cell is entered into the queue higher in the queue than the 

^in^ 

DEADLINE INTERVAL Dl 

ETar Dltrer^ F ' F ° th6 " ard ™> ,ime t0 deadli " e ' aI - called "deadline 

Z D , ,2" ' d T**' c h ? thG proc ; ess,n 9 execu, ion time E required. For an arriving packet N the deadline 
mterval DI N ,s the drfference between arr.val time A and the deadline instant D N by which the particular channel must 
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receive new data or suffer a frame of silence. If a packet has plural frames with different deadlines, the deadline interval 
Dl is computed for each frame from time "NOW" to its respective deadline. As time elapses Dl decreases, as the "NOW" 
approaches deadline D. 

[0108] The formula for computing deadline interval Dl in the scheduler often need not be revised if there is an egress 
buffer (called Egress Buffer in FIG. 1 and Egress Channel Buffer in FIG. 9) following the voice decoder. However, some 
embodiments do make the sample Fl FO run asynchronously to the decoder, or insertion of very late out of order packets 
into the sample FIFO then the deadline interval Dl should be computed relative to deadline instant for sample FIFO 
output and not relative to the deadline instant for frame output from the egress packet queue that feeds the decoder 
in FIGS. 1 and 9 (and called channel buffer in FIG. 11). 

[0109] A recursive first procedure for computing the cell deadline entry D for new cell j 1541 is given as: 

DIj = A - [ (Deadline D entered in queue for packet with highest 
sequence number Si for given channel C) + (Frame size F for 
process being used in egress channel C) x (Sj - Si - 1) ] 

where Sj is the sequence number of the out-of-order packet. 

[0110] DIj = Aj - (T 0 + (i - 1)F) - (Sj - Sj - 1)F as further described below. 

[0111] This first procedure depends on calculating deadline D for an original first packet when no cell has yet been 
established in the queue. Thus, the deadline D for that original first arriving packet is computed as the time when the 
decoder is first ready to accept that first packet minus the time of arrival A of that first packet. The deadline for each 
subsequently arriving packet is then computed from the formula. Note further that if the first packet was out of order, 
then the lower sequence number of a later-arriving in-order packet will produce a negative number for (Sj-Si-1) and 
thus may cause one or a few packets to be (acceptably) lost by virtue of passing their deadlines at the beginning of 
the transmission. This first procedure, being recursive, works well when the process of maintaining the queue has high 
reliability and low error rate. Error checking and redundant storage in the queue keeps errors low. 
[0112] A second procedure for computing the deadline provides a storage location for the time To when the decoder 
was first ready to accept the first packet, and then continually increments that storage location with the frame size F 
in 10ms units. For the ith packet, the decoder will be ready to accept that packet i at a time T = To + (i-1)F. The deadline 
interval DIj is the latest packet time of arrival Aj less the decoder-ready time Dj. Be careful not to confuse deadline 
interval Dl s with deadline instant Dj. Thus, DIj = Aj - Dj. In this second procedure, the formula forthe cell deadline interval 
entry is 

DI^Aj-CTo + O-^F. 

[0113] This second procedure works well when there is substantial coherence or synchrony between the clock that 
produces the incrementing on indices i and j, and the clock that produces the sequence numbers S. 
[0114] A third procedure uses both the first and second procedures, with error checking, for high even higher reliability 
when desired. 

[0115] Further the process drops packets that remain beyond their deadline as decremented. There is no point in 
processing such packets, and they may be discarded. Assume the process waits for the out-of-order packet. There is 
a moment in time in which the packet can be lost. If the packet is lost, the decrementing process in the queue determines 
when it is lost. When the time has passed for the lost packet to arrive, and it is still not there, then the time has come 
for the decoder to put out blanks or noise into the audio stream, or otherwise do what the decoder is established to do 
reconstruct or otherwise handle lost packets. 

[0116] in a first approach to handling out-of-order packets, the process detects sequence number (tag, time stamp, 
etc.) and channel number in the header of arriving packet 151 1. The process goes through the process as described 
above; however, the out-of-order packet to be decoded has a deadline in the channel record 1 41 3 equal to the deadline 
interval ( M 3") plus the frame size number ("4") multiplied by the number of missing sequence numbers. So, if the out- 
of-order packet has one currently-missing packet in between the out-of-order packet and the most recently previously 
received packet in the same channel, then the deadline number is entered to the queue 1431 as a cell with deadline 
revised to be 3+1 x4 = 7. Thus, in a system with a sorted queue and known frame length for a given process, this process 
confers an elegant and advantageous solution. 

[0117] In a second approach, a separate storage area holds the out-of-order packet (e.g., in a stack) until the next 
in-order sequence numbered packet does in fact arrive. The in-order packet is issued a new cell 1541 and new cell 
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10ms boundary. This is called synchronous. 

[0132] Yet a further embodiment has asynchronous channels wherein the channel decode does not start on a 1 0ms 
boundary even though the GCD of the frames is 10ms. Running the channels asynchronously provides advantages 
of software management of the decode processes. Here, the deadline entries in the cells are suitably provided in more 

5 granular fashion (e.g. numbers pertaining to 5ms, 1ms, or a fraction of 1ms in various versions), and still represent the 
time remaining until the frame is needed by its respective decode process. What is different is that the respective 
decode processes do not all begin on the same GCD time boundary. Thus, the channels could be synchronized on 
1ms, or say a 125usec boundary in which the channel decode starts, for which deadline numbers are provided with 
higher resolution. Thus, the GCD 1 0ms approach is not required, but does provide one group of elegant embodiments. 

10 [0133] Foreground processing does not disturb the background processing thus advantageously a fine degree of 
isolation. Transfer from incoming packet all the way to the queue 1431 either operates on a high priority level. 
[0134] Foreground processes are higher priority processes such as those that are initiated by an interrupt. For ex- 
ample, host 1 01 writes a packet to memory by stealing computer cycles and sending an interrupt to the DSP C6201 . 
(Alternatively, the DSP polls for a host write to determine when the host write is occurring.) Everything stops for the 

is foreground process. At the same time, the main process calls the interrupt routine, stops the main process while the 
interrupt routine runs, and then processing returns from interrupt to resume the main process. The interrupt routine is 
written to take a relatively short time to execute, and this is called foreground processing when it has a higher priority 
for processor resources as opposed to the main process in the background. 

[0135] Host updates egr_chnl_rec records including channel record 1413 by one process. Another process adds 

20 new cells 1541 to queue 1431 . A further process decrements the queue cell deadlines. A still further process throws 
away cells and packets that have gone past their deadline. Yet another process issues packets based on the highest 
queue cells to the decoder process, which is still another process. Numerous choices are available to the real-time 
processing engineer skilled worker- for example, what interrupts shall be host interrupts, which shall be clock interrupts, 
what hierarchy of interrupt priorities shall be, what processes shall run in the foreground and background, and what 

25 routines shall take how long relative to one another. Many alternative process, device and system embodiments result 
from these choices, and it is unnecessary to belabor the explanation of these alternative embodiments further. 
[0136] In FIGS. 14-17 when the packet arrives, the whole process of looking up channel data and updating queue 
1431 could all be done at the same time. However, if the interrupt breaks the normal sequence, just as the top cell of 
the queue 1431 is being taken off to feed a decode process, then a frame might be lost. To avoid this problem, the 

30 process of taking off the top cell of the queue 1431 also includes a step of disabling or masking interrupts. Also, the 
interrupt routines are kept advantageously short. In this way conflicts between different processes are made negligible. 
Also, when the link list is being updated and pointer values are being changed, the link list might be broken if an interrupt 
routine intervenes just then. Assign the pointer so the list is not broken, and then move the pointer down, and this part 
of the process is done, and the element is free-in this way list integrity is preserved. Notice this is a good reason for 

35 making the process short, so that a cell can be detached with just two or three program statements. If there were too 
many statements, it might otherwise be necessary to disable the interrupts which desirably is avoided for the most part. 
[0137] Maintenance of queue 1431 by decrementing deadlines every 10ms is suitably triggered by a 10ms clock 
interrupt from the DMA (direct-memory access) hardware. The DMA is programmed for the ingress side to continually 
put data from a T1 line (1 .544 Mbps telephony communications line) into the buffer or buffers. The egress side DMA 

40 takes the data from the buffer on a continuous basis and puts the data on a T1 line going out of the system. Every 80 
samples is just interrupt. Notice the DMA is running by cycle stealing, and the interrupt can take place while the DMA 
is still running. 

[0138] In FIG. 19 cycle stealing is a process which allows the system to run two blocks at the same time, such as 
the microprocessor MPU and DMA working off the same memory MEM which MPU and DMA share on the same bus. 
« The processor does arithmetic while DMA uses the bus to talk to MEM, and then MPU accesses MEM while DMA is 
inactive. The bus has address lines, data lines, and control lines. Without DMA : MPU has every bus cycle available to 
it. When DMA needs a bus cycle to read or to write to MEM : then DMA pulls one of the control lines to deny the bus 
one cycle to the processor. Cycle stealing is this process, and is performed by hardware. 

[0139] Keyboard entries by user are important but few and far between compared to the data processing tasks of 
50 the MPU. Keyboard triggers I/O in the foreground, while background heavy duty calculations proceed, which can be 
interrupted without any problem. 

[0140] Independently a process called Updating queue 1431 adds each new ceil 1541. The updating process is 
initiated by host interrupt responsive to reception of a new packet. 

[0141] FIGS. 1 9 and 20 show the interrupt signals, their priority and what signals go to what interrupts in FIG. 1 5-1 7. 
55 The processor is suitably interrupted by a 1 0ms interrupt and an arriving-packet interrupt pck_in_intrr. 

[0142] In FIG. 19, a sampling clock to an I/O stream DMA takes the data from 24 voice channels into a twisted pair 
T1 line of USA. Europe has a 32-channel E1 standard. The system takes the I/O data and puts it into memory. DMA 
clock produces the 10ms (80 samples, 8KHz standard telephony sampling rate) sampling clock. 
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archical. 

[0153] In this embodiment #2 BIOS™ RTOS is combined as a wrapper with the ingress/egress processing. Using 
BIOS™ RTOS OK of code) to organize the scheduling ; gaining information about the packet, and preempting the 
system for cg-css saves . about-to-be-lost packets. The arriving packet runs a routine under BIOS™ to determine 
whether preemption is necessary (packet is Early, Late or Very Late, but not Too Late in FIG. 20), and then preempts 
to save packets 

[01 54] Another prcccss embodiment features fine resolution when all the channels are out of sync. The fine resolution 
orders the link hsts nccordmq to exact amount of time to deadline if all the decoder processes are running out of sync 
with one anotfer Tn^ poccss records and updates a set of different deadline times for each decoder process running 
on the system to compute the dcadmc interval when the decoder processes run out of sync with each other (i.e., 10 
millisecond intends m each decoder are staggered and thus end at different instants). In this way, the sequence queue 
1 431 still advantageously * cods '.rack of Dl of packets from channel to channel since Dl is properly calculated for each 
based on the dend^ c msurt respective to that channel decode process. This fine resolution process is suitably com- 
bined with any of mo processes d! FIG 20. 

[0155] Suppose !• u-.s*s *rc £0 milliseconds, with 500 microseconds processing time in the decoder and 32 
channels. The time no* -.>-<.: tc v xess mc crannels contends or interferes with the need to process laterarriving new 
packets. 

[0156] In FIG. 20 p'eo^; -x< jyjr^cnt $2 advantageously utilizes relatively slow, less expensive DSP processors 
for processing mnny c^'-h-is '* ^ o^OoO«n»cnl features limited use of preemption for very late packets in a slow 
system, say using u"c w >*<,,. t - D->*s m * line card for four channels. For four channels, while the basic time per 

process is the same me *tr?v,w".: ;*^e **oticd for the process for slower processors would be not 500 microseconds 
but three (3) to five (S> m.u» ( vonas (ten imcs as much). In that case, the preemption becomes more important. The 
egress packets have pr cr r rt r»c :*»ey .ire shft ordered according to the time interval remaining to deadline, but simply 
all of them have pnonr> o\c .n^cic z>,*ckc:. Thus egress is not random but ordered according the need for the 
egress packets to bo cioeuicd c presetted Tnis embodiment is particularly advantageous for smaller inexpensive 
systems in which case :ho fo^v^c BiOS ,M RTOS is suitably used. 

[0157] In embodiment #3 o * >G 20 o'cjnni/e processing with egress packets still organized according to priority 
and still deal with emo'r>ooT *<T^«»ons but preempt any ingress packet when any egress packet is available to be 
processed in the last 10 m»«iMv->nd ported (Very Late category only). The Late packets (20 milliseconds) and Early 
packets (30 milliseconcs cr more* not used to preempt, and non-preemptive processing is used to handle these™ 
Late and Early packets. 

[0158] FIG. 20 embodimcrt! $i ^cvrintngeously uses preemption to process Very Late packets at a higher interrupt- 
priority than Late and Earfy p*c*ets (pnorty 2). 

[0159] FIG. 20 embodiment ft «s described in detail in connection with FIGS. 4 and 31 . 
PREEMPTIVELY HANDLING 'V^RY LATE" PACKETS 

[0160] Before reading FIG 21 25 cons dcr the processing limit {vertical dotted line in FIG. 12). This limit becomes 
crucial to saving a Very Late p^Oc* N from being lost. Even 500 microseconds of decode execution time E M (for an 
Mth packet in decode) is mportrtn: here Suppose a Very Late (FIG. 20) egress frame N arrives withJDi N only 600 
microseconds of life left and soon -isks being thrown away regardless of the sequence queue processing. Further 
assume that decode processing execute time E N for this packet frame requires 200 microseconds, leavingjess time 
(600-200=400, which is less tr an t w 500) than the total execute time E M of 500 microseconds for a decode in progress 
for another channel, say. This amojnts to a preemption decision criterion DI N -E N >E M (or E M +E N <DI N )jwhich is still 
further, refined below. Preemption of the egress processing in the other channel can save the day by task preemption 
(FIG. 20 embodiments #3. «4 ara *5) wncn me actual time T needed to complete the egress decode processing in 
progress is sufficiently advanced n*> described next. 

[0161] Interrupt computation tine is suitably also taken into account in the calculations in some embodiments, so 
that if processing the interrupt wit occupy enough time that there is no point in handling a Very Late packet, the interrupt 
is not taken or is aborted. 

[0162] Note that egress processing in the other channel may be at an intermediate point. The full 500 microseconds 
may not be needed to complete the egress processing of that channel because some time T=400 has elapsed, and 
decode execution is some fraction of the way (say 80%) to its own completion of E M =500 microseconds of processing. 
Thus, suppose only 100 microseconds are needed to complete the decode in progress. Then the very late packet in 
the waiting channel has a chance to proceed, succeed in decode, and be saved from loss, since 100 + 200 = 300 
which is less than the 600 microsecond deadline interval of the example. In other terms, (E M -T)+E N <DI M . Implicit in 
these examples is the criterion in FIG 20 tnat packet N is not Too Late, i.e., DI N -E N >0. The deadline for the new packet 
N is sooner than the deadline for the packet M in decode. Otherwise the packet M decode would not be preempted in 
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this embodiment. Since the longer time DI M to deadline is what is relevant for packet M, the preemption decision is 
written D M >E M -T+E N . Thus, the processing in various ways can be designed (FIGS. 22, 23 and 24) to signal.how many 
microseconds remain in the channel decode processing currently underway and preemption is based on the decision 
criterion (DI N -E N >0 AND DI M -E M +T-E N >0). 

5 [0163] These considerations lead to Embodiments #3, #4 and #5 of FIG. 20 that do special handling of Very Late 
packets (FIG. 20, third column). Here processing provides information back to the scheduler telling where the decode 
process currently is in its operations, thereby to make a decision to preempt or not to preempt or just to throw away 
the packet. Embodiments for keeping time on this very fine time scale are disclosed next in FIGS. 21 , 22, 23, 24 and 25. 
[0164] FIG. 21 compares and contrasts channel decode processes of a Same-Deadline type and a Staggered Dead- 

10 line type. At the top of FIG. 21 , egress and ingress for all 32 channels are handled in a 10 (ten) millisecond window 
2105 that extends from left to right across the page. All the channel decodes in the Same-Deadline channel decode 
process type need to be finished by an instant 2111 of the 10 millisecond Deadline. The execution order of various 
channel decode executions e1 , e2, ... e31 for the 32 channels is relatively unimportant. If a packet for a given channel, 
e.g., channel 7, has not arrived, then the channel 8 decode is performed. When the channel 7 packet does arrive, then 

15 it gets decoded, occupying execution interval e7. The ingress execution (Ingress Overhead interval) is suitably per- 
formed for the channels at beginning, at the end, or sometime in between, such as when not all channels have been 
decoded, and the system is waiting for more packets to arrive which have deadline 2111. Also, packets with a later 
deadline than deadline 2111 are suitably decoded, when there is time available for them. Also, such embodiment 
responds to very late arriving packets that do have deadline 2111 by preempting packets and packet decodes that 

20 have a later deadline than deadline 2111 . 

[01 65] Compare now Staggered Deadline processes having theirdeadlines Di spaced along a 1 0 millisecond window 
2121 having a clock boundary 2125. No longer does the clock boundary 2125 represent a single same deadline for all 
the 32 channels. Now, decode execution order for the various channels becomes important even for packets whose 
decode deadlines lie in the window 2121 . Very-late execution order is important, and very late packets in some em- 

25 bodiments are made preempt other very late packets, as well as late and early packets, in order to reduce incidence 
of avoidable packet loss. 

[0166] In FIG. 21 beneath window 21 21 , one example of the advantageously intelligent decode execution of packets 
in a Staggered Deadline process embodiment begins by recognizing the order of the deadlines Di in window 2121. 
For example, suppose the deadlines come in the order D4, D9, D3 ; D5, D1 , D2 for illustratively six of the 32 channels. 
30 Packet 4 (meaning the channel 4 packet having deadline D4) is present, and the embodiment launches decode exe- 
cution of packet 4 r which occupies execution time interval E4 which completes not only ahead of the deadline D4, but 
coincidentally also prior to the instant D4-E4 when execution of packet 4 would have had to commence to save the 
packet 4 from loss. 

[0167] Decode execution of packet 4 being completed, operations proceed to detect the presence of packet 9, which 
35 turns out to .be present. The embodiment launches decode execution of packet 9, which occupies execution time 
interval E9 and completes ahead of the deadline D9, and interestingly after the instant D9-E9, the latest time packet 
9 would have had to commence decode. 

[01 68] Decode execution-otpacket 9 being completed, operations proceed to a detection step to test for the presence 
of packet 3. However, the detection step determines that packet 3 has not arrived. Thereupon, operations test for 
40 presence of packet 5 which has the next most urgent deadline D5 after deadline D3. The detection step determines 
that packet 5 is present, and decode execution of packet 5 is launched (LAUNCH 5) quite significantly before its deadline 
D5. 

[01 69] Suddenly, packet 3 arrives very late. The embodiment responds to packet 3 by calculating that sufficient time 

exists to save packet 3, and therefore proceeds to preempt the now-underway decode execution of packet 5, Operations 
45 jn FIG. 21 moving upward along the arrow PACKET 3 SAVED to LAUNCH 3 representing the operation of launching 

decode execution of packet 3. (Note that packet 5 decode is partially complete and these results are saved temporarily.) 

Decode execution of packet 3 occupies execution time interval E3 which successfully completes before deadline D3 

and incidentally after the latest instant D3-E3 when packet 3 decode would have had to commence. 

[0170] Decode execution of packet 3 being completed, operations do not need to proceed to the detection step to 
so test for the presence of packet 5. Instead, operations RETURN to the point where decode execution of packet 5 was 

interrupted earlier, whereupon decode execution of packet expends the balance of execution interval E5, and completes 

decode not only ahead of deadline D5 but even ahead of instant D5-E5. 

[0171] Decode execution of packet 5 being completed, operations proceed to the detection step to test for the pres- 
ence of packet 1 which has the next-most-urgent deadline D1. However, the detection step determines that packet 1 
55 has not arrived. Thereupon, operations test for presence of packet 2 which has the subsequently-next most urgent 
deadline D2 after deadline D1 . The detection step determines that packet 2 is present, and decode execution of packet 
2 is launched (LAUNCH 2) well before its deadiin D5. 

[0172] Suddenly, packet 1 arrives very late, see SUDDEN ARRIVAL OF PACKET 1 . The embodiment responds to 
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packet 1 by calculating that sufficient time exists to save packet 1 , and therefore proceeds to preempt the now-underway 
decode execution of packet 2. Operations in FIG. 21 move upward along a vertical arrow to launch decode execution 
of packet 1 fortuitously just at the last instant D1-E1 available for packet 1 decode to commence. (Note that packet 2 
decode is partially complete and these results are saved temporarily.) Decode execution of packet 1 occupies execution 
5 time interval E1 which successfully completes precisely at deadline D1 (PACKET 1 SAVED). 

[0173] Operations now RETURN to the interrupted decode execution of packet 2 at the point RESUME 2, whereupon 
the balance of execution time interval E2 is expended, and whereupon decode of packet 2 successfully completes 
illustratively, fortuitously and precisely at deadline D2. 

[0174] FIGS. 22, 23, and 24 illustrate three different embodiments foraccomplishing interrupt (preemption) processes 
10 for saving packets as illustrated in FIG. 21. Where similarity or identity of function of blocks in FIGS. 22 : 23, and 24 is 
disclosed, the last two digits of the numerals are made the same from Figure to Figure. To better comprehend each of 
the FIGS. 22, 23, 24, the reader is advised to study the descriptions of all of them, and compare and contrast with the 
last two digits of numerals in mind. 

[0175] The skilled worker prepares any of a variety of embodiments to accomplish the functionality of FIG. 21 and 
is the like, allocating process steps to foreground and background processing, or to main and preemption or interrupt 

processing in a manner effective to accomplish these functions and suggested in FIGS. 22, 23 and 24. Testing and 

debugging are, of course, inherent in the development process to effectuate the teachings herein. 

[0176] In FIG. 22, a first process embodiment encounters arrival of a packet 2201 having Frame in channel N of 

decodable real-time information, and in a step 2205 receives, depacketizes, and enters the frame in channel N into an 
20 Egress Packet Queue of FIG. 9. Concurrently, a decoder process 221 1 for a frame in different channel M is in progress 

to produce a Decoded Channel Output. The process provides a timer 2215 of elapsed time of the decoder process 

2211 . wherein the decoder process sets up the timer 2215, and sets the timer 2215 running. 

[0177] Meanwhile, due to arrival of the new packet (see e.g. SUDDEN ARRIVAL OF PACKET 3 or 1 in FIG. 21), 

high priority interrupt process steps begin at BEGIN 2221 . Next, a step 2225 computes Deadline Intervals Dl for the ■> 

25 frames in channels M and N. The interrupt task accesses the timer by input of Elapsed Time T in a step 2229, — 
[01 78] A decision step 2231 determines whether there is enough time to execute both packets before their respective 
deadlines. (Compare with the part of FIG. 21 involving LAUNCH 3 and LAUNCH 5 wherein packet 3 is saved.) For ? 
channel N, e.g. channel 3, Deadline Interval Dl less the decoder decode execution time EN required to decode a frame 
in that channel N is tested for greater than zero as a First Condition. For channel M, e.g. channel 5, Deadline Interval; 

30 Dl less the balance of decoder decode execution time required to finish decoding a frame in that channel M is computed - , 

less the time EN to be spent decoding channel N during the interrupt: as a Second Condition. The just-mentioned 
balance of decoder decode execution time required to finish decoding a frame in that channel M is EM minus Elapsed # 
Time T. Thus, in the algebra the second condition becomes DIM - EM + T - EN > 0. 

[01 79] In decision step 2231 , if BOTH the First Condition and the Second Condition are true (YES), then operations : - 

35 proceed to a step 2235, to test whether the deadline for the channel N is less than (more urgent) than the deadline for - : - . - 

the channel M decode in progress. If so, YES, then operations branch to a step 2241 to execute a preemption process 
for the frame in Channel N which decodes it and expends decode execution time EN. This branch corresponds to the 
FIG. 21 upward arrow PACKET 3 SAVED and action of LAUNCH 3. 

[0180] In step 2235, if the result is NO, then operations proceed to a step 2251 to add Frame in Channel N to the 
40 Sequence Queue (egr_sched_list) as in FIG. 13 step 1215, and block 1431 of FIGS. 14 and 16. In other words, channel 
N is not as urgent as channel M decode. 

[0181] In step 2231, if the result is NO (either or both of First Condition and Second Condition is not true), then 
operations branch to a step 2261 , to discard the packet in Channel N. This packet is too late to be saved, or too late 
to be saved without losing already commenced decode in channel M. Thus, a packet triage is executed. 
45 [0182] After any of the steps 2241 , 2251 and 2261 , operations pass to RETURN 2271 , whereupon the decoder in 
step 2211 suitably resumes any interrupted operation therein. 

[0183] In FIG. 23, another embodiment has egress buffers 1175.a, 1175.b, ... 1175.q (compare FIG. 11) for depack- 
etized data frames. The egress buffers 1175.a, 1175. b, ... 1175.q are provided with respective counters 2305. a, 
2305. b,... 2305. q arranged to hold counts representing or proportional to a number of bytes or words yet to process in 
50 the egress buffer 1175. i for each channel i. These counters 2305. a, 2305.b,...2305.q are counting continually during 
the decode process and are advantageously used as timers as follows. If 320 words need to be processed in 500 
microseconds : and the counter points to 1 80 words left, then elapsed time T is 250 microseconds (1 80/320, T=(320-C) 
/320 and C=180). 

[0184] Thus, the embodiment of FIG. 23 advantageously provides an environment (in hardware : software or mixture 
55 thereof as skilled worker chooses) to make egress data counters meaningful in measuring time. If the system is arranged 
so that all deadlines for decode fall on the same set of 10msec boundaries then preemption of Late packets by Very 
Late packets suffices to sav Very Late packets. (The system is provided with sufficient processing power to process 
all Very Late packets even if all channels are active and so, the order of decode execution of the Very Late packets is 
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2413 (shown as an oval above decode process 2403, and in more detail at the right in FIG. 24. Also, break process 
241 1 .1 updates (either incrementing or decrementing methods suffice) a register 241 4 so that the contents of register 

241 4 indicate a value proportional to or representative of the time elapsed into the decode execution of decode process 
2403. 

[0194] A quick pass through scheduler 2413 process steps at right in FIG. 24 takes care of any just-arrived packets, 
whereupon operations return to decode process 2403, and execute decode of 20 more bits at step 2409.2, followed 
by another break process 2411 .2, and so on through 2409.3, 2411. 3, ...240.9k, 2411 .k and decode completion at RE- 
TURN 2415 

[0195] When, as noted above, scheduler 241 3 is called, operations commence at BEGIN 2421 and then a step 2425 
calculates !hc deadline interval for a just-arrived packet in, say, channel N. Next a step i2429 inputs a value Tfrom 
fc^is:cr 2414 representing elapsed time into decode process 2403. Operations proceed to a block of steps 2481 in- 
cluding steps 2431 . 2435, 2441 , 2451 , and 2461 which are described in the same way as were the steps 2231 , 2235, 
2241 2251 and 2261 in block 2281 of FIG. 22. After operations in block 2481 of FIG. 24, a RETURN 2471 is reached. 
[0196] In FIG 24 at step 2407, when the frame encountered represents an interval of silence, operations go to a 
slop 24 1 6 to toad register 241 4 with an update representing the duration of the silence. Next a step 241 7 decodes the 
silence as no-soi-nd or as white noise, or as decaying energy, or otherwise according to the silence decode process 
acsired and selected by the skilled worker. A just-arriving packet in another channel suitably interrupts this silence 
decode process 2417 using scheduler 2413. After silence decode step 2417 operations there reach RETURN 2419, 
[0197] FIG 25 illustrates a break process used in blocks 2411.1, 2411.2, 2411.3,... 2411. i of FIG. 24. Operations 
ixmricncc nt 3EGIN 251 1 and then at a step 251 5 save decode parameters and data from the previous 20 BITS step 
2-0<* i to the extent needed to initiate the next 20 BITS step 2409. i+1 when the latter's time comes. After step 2515 
operations at a s:ep 2521 update register 2414 with decode execution time remaining (or decode time elapsed) as 
coordinated w th steps 2429 and 2431 of FIG. 24. Thus, decode time elapsed is input as time T in step 2429 and used 
as shown in step 2431 . Decode time remaining (Tr) is alternatively fed to step 2492 and the test in step 2431 is made 
to bo |(DIN-EN>0) AND (DIM -Tr - EN >0)]. 

[0198] In FIG 25 operations go from step 2521 to a step 2525 that calls the scheduler 2413 that is suitably imple- 
mented as shown in FIGS. 22, 23 and/or 24. FIG. 25 also suggests a process embodiment wherein flag software is 
u?ed in the scheduler 2413. The flag is turned on when a suitable test determines that any other packet or channel 
shou'd be given priority over the decode process underway in FIG. 24. When this flag is on (YES) operations branch 
from step 2531 to a step 2535 to start decode of the priority channel. Note that operations may nested such that even 
that priority decode nay be interrupted, whereby starting in step 2535 does not signify uninterrupted run to completion. 
After step 2535. or when the bypass flag is OFF in step 2531 (NO), then operations go to a step 2541 to recover the- 
decode parameters and data from step 2409. i, whereupon operations proceed to a step 2551 to return and go to the 
now-current channel decode process 2409. i f 1 . 

[0199] FIG. 26 details a process example of embodiment type #5 of FIG. 20. Operations commence with Egress 
Begin 2611. and then at a step 2615 put an egress packet in a queue 2625. Next, a decision step 2621 tests to see 
whether Deadline Interval Dl. for the latest packet in the queue 2625 ; exceeds a certain threshold number K of bytes 
(words or frames, etc. as skilled worker chooses). For example, suppose a frame 2531 is the packet that is the latest 
(lowest Dl of all frames) in the queue. The frame 2531 is an early frame. Its Dl exceeds the number K. Step 2621 
determines YES and branches to step 2641 , which calls an ingress process because there is plenty of time to fit the 
ingress process before any more egress processing is necessary in the channel. 

[0200] If the test in step 2621 turns out to be NO, operations go to step 2651 to execute the egress process as 
discussed earlier hereinabove, whence a RETURN 2655 is reached. Also, if during the ingress process called in step 
2641 . the lowest deadline interval Dl becomes less than K in decision step 2671 , such as by entry of a newly-arrived 
packet 2661 into a queue 2625 position 2665, then a branch from decision step 2671 goes to egress step 2651. 
Otherwise, step 2671 determines YES and operations pass to RETURN From Ingress 2645 and back to step 2621 . 

SILENCE PROCESSING EMBODIMENT 

[0201] Since silence processing has a much shorter processing duration than voice processing of a frame, the de- 
coder in FIG. 24 suitably determines whether the packet is voice or not in block 2725. If not voice (i.e. silence), then 
the register 2418 is loaded with a silence processing period T = 5 microseconds, for instance, and the silence packet 
is decoded, followed by a return. The scheduler 2413 checks the register 2418. A very late arriving packet that might 
have been discarded at step 2431 , is now advantageously saved because the T value is so much less at stop 2429 
for a silence packet. 
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SINGLE CHANNEL EMBODIMENT 
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[0212] In the system of FIG. 27, the silence packets and their corresponding calls are used to schedule link list 
records in queue 1431 of FIG. 1 6. A silence packet has a usual header but a shortened payload compared to a voice 
packet. The payloads are stored in memory that in some embodiments have fixed locations even when the decode 
processing 2725 decodes from that fixed location. The code includes the capability of informing the front end queue 
5 management that a space has become available, so that when the packet has been decoded, that space is returned 
to availability as part of the queue space for new packets. 

[0213] In both the systems of FIG. 14 and FIG. 27, the process is robust even if a silence packet and a consecutive 
voice packet arrive out of order. Sequence numbers of the packets are checked and deadline interval determined, thus 
automatically providing resequencing as the link list 1431 is updated. Then the decode knows it is a silence packet or 

w voice packet because the header provides this information. 

[0214] A management method by which the scheduling list 1431 is managed, decrements values in packets, adds 
packets, takes packets at top of queue and sends them to decoder. If the packet at top of queue is a silence packet, 
it likewise goes to the decoder 2725 in the FIG. 27 embodiment. The decoder detects that it is a silence packet, and 
detects the number of words of silence. Then the postprocessor 2741 updates the channel record with updated deadline 

15 interval. Silence processing takes less time (e.g., 5 microseconds) than voice processing, at say, a few hundred mi- 
croseconds. Silence processing suitably fills an area of output buffer 2751 or memory with zeroes or noise with pre- 
determined spectrum similar to previous voice packet, or interpolation, or other silence data. 

[0215] Since silence processing has a different processing duration, the decoder or a data store takes account of 
this in operating the processor to consider it as a very late packet, or to issue timing to a register; or in determining 
20 whether to allow the ingress process to go forward in lieu of the egress process as described earlier above. 

[0216] The decoder tells the scheduling list how far it is in its processing. In some embodiments the decoder and 
scheduler both form part of a nonpreemptive scheduling loop. 

[0217] In preemptive embodiments, the process suitably is made to look ahead where a segmented decoder process 
of FIG. 24 allows itself to be interrupted because of a late arriving packet. 

25 [0218] Conversely, suppose a silence packet is the arriving packet. Even if the silence packet is very late : even later 
than a voice packet which would have been discarded, the silence packet also has a larger deadline interval Dl because 
it takes less time to be processed. In some embodiments a lost packet is treated the same as a received silence packet, 
and this consideration is less important. But in other embodiments a received- silence packet is decoded to produce a 
different output sound from the sound which the decoder produces in response to a lost packet event detected in the 

30 last 10 milliseconds before the deadline for example. Also, in embodiments where a received silence packet contains • 
a number indicating a value S of how many frames of silence, and a lost packet event only signifies a predetermined 
number of lost voice frames, then saving a silence packet from loss is also important. Thus, the deadline interval 
calculation advantageously saves silence packets for decoding that would otherwise be discarded. 

35 CIRCULAR OPERATIONS 

[0219] The next sections describe a solution to the problem of handling packet processing deadlines in the context 
of a system having circular buffers and a system timer counter rollover (circular time) and packet time-stamp rollover. 

•to Counter Size 

[0220] To use circular time, select a desirable clock rate r CLK [Hz], and corresponding clock cycle period c CLK =1/r CLK , 
and an estimate of the largest interval of time t MAX [sec] that ever needs to be maintained by the system. That provides 
the required clock range [number k] which leads to number of bits [number b] needed to implement the clock. The size 
45 t max °f tne system clock (clock range) is made at least twice the largest time span t MAX between any two most time 
distant packets that will ever occur in the system. 

[0221] For standard 8kHz telephony, a 16-bit clock provides a total span of over 8 seconds (125u.sec*2 16 >8sec) 
which substantially exceeds the longest time span between any traces of two most distant streaming media packets 
that will likely exist concurrently in a given channel in a global system. Thus tM AX =2 16 and k-1 = 2 16 -1 . 
50 [0222] Let the 1 6-bit circular time clock have a buffer of the size 2 16 words having 2 16 addresses. 
[0223] To create an "automated" process, use a system clock modulus T MAX where 

1 max = 2 * t MAX^ 

55 

where t MAX is defined as before: t MAX is the linear time range or difference that includes any two most distant events, 
the record of which is ever concurrently present in the system. 

[0224] Define now new operation circ T (t A , t B , T^x) for any two values t A and t Br where 0<t A < ( MAX; 0<t B <t MAX . Let 
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A = , A-t B ; 

then 



if 0 < A < t MAX then circ T (t A , t B ) = A; [circ T is positive, no straddle] CASE 1 
if " 1 max - A > -T MAX then circ T (t A , t B ) = A + T MAX ; 
[circ T is positive, straddling) CASE 2 

if 0 > A > -t MAX then circ T (t A , t B ) = A; [circ T is negative, no straddle] CASE 3 

if 'max s ^ < T MAX then circ^- (t A , t B ) = A - T MAX ; 

[circ T is negative, straddling] CASE 4 

If after obtaining value of A as a result of above 

If A equals T MAX then circ-,-{t A) t B ) = 0 
If A equals -T MAX then circ T (t A , t B ) = 0 

[0225] FIG. 28 illustrates the four results above designated Case 1 , Case 2, Case 3, and Case 4. Rightward arrows 
for A or c.rc T .nd IC ato that their sign is positive, wherein event A has occurred after event B. results are designated 
Case 1 , Case 2, Case 3, and Case 4 in FIG. 28. Leftward arrows for A or circ T indicate that their sign is negative 
wherein event A has occurred before event B. 

[0226] A clock face 2811 shows circular time that goes from one (1) "o'clock" to T MAX as its "twelve o'clock " Times 
t A and t B show up as large dots on the clock face 281 1 A 1 80-degree turn is designated t MAX . This 1 80-degrees is a 
span within which the system determines the order of events A and B using the circular time difference process de- 
scribed here. A small circle 2821 suggests the system clock incrementing with fine resolution like a second hand on 
clock face 2811 . as linear time moves from left to right from zero (0) to twice T MAX . 

[0227] In FIG. 29 circular time operations to provide circular time difference At 9 , which signifies circ T (t. t R ) com- 
mence w.th a BEGIN 2905 and proceed to input tags or computed values representing a pair of times t A t B Next a 
step 2911 finds their l.near time difference A = t A - t B . A decision step 2915 tests the sign bit of the difference from step 
2911 next. If the sign bit is positive, then a decision step 2917 tests the most significant bit (MSB) of the difference 
from step 2911 . 

[0228] If the MSB is zero (0), meaning the difference is in the low half of an interval zero to + T MAX then a Case 1 
condition of 0 < A < t MAX is present and Aty is set equal to A. Then a step 2925 sets a flag representing that AU is 
positive. If the MSB is one (1) in step 2917, meaning the difference is in the high half of an interval zero to + T M Iv 
' h o e " a C : ase „ 4 condttion of 1 max S A < T MAX is present and At e is set equal to A - T MAX .in a step 2931. Then a step 
2935 sets a flag signifying that the circular time difference At 8 is negative. Note this advantageously remarkable oper- 
ation: a POSITIVE LINEAR time difference is converted and interpreted to be a NEGATIVE CIRCULAR time difference 
sometimes and not others. 

[0229] Turning now to the other side of decision step 2915, suppose that the sign bit is negative for the linear time 
rn^f A = U " tf3 ' Th6n 3 decision ste P 2941 tests tne most significant bit (MSB) of the difference from step 2911 
[0230] If the MSB is one (1), meaning the difference is in. the low magnitude half of an interval zero to - T MAX then 
a Case 3 condition of 0 > A > -t MAX is present and At e is set equal to A in a step 2945. Then operations go to the step 
2935 which sets a flag signifying that the circular time difference At e is negative. If the MSB is zero (0) in step 2941 
meaning the difference is in the high magnitude half of an interval zero to - T MAX , then a Case 2 condition of -t Mav s 
A * - t max IS present and At^ is set equal to MA * 
[0231] A + T MAX in a step 2951 . Then operations go to the step 2925 which sets a flag representing that At« is positive 
Note this advantageously remarkable operation: a NEGATIVE LINEAR time difference is converted and interpreted to 
be a POSITIVE CIRCULAR time difference sometimes and not others. 

[0232] After either of steps 2925 and 2935 operations then go to RETURN 2927, completing the operations of this 
advantageous circular time differencing embodiment. 

[0233] The four components of the process above are ordered according to the results. Less procedurally complex 

is the view ordered according to the value of A. This approach is illustrated in FIG 30 

if 
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(A>0) 

{ if (A < 14T MAX ) At e = A; else At e = A - T MAX ; } else 
{ if (A > - 1 /?T MAX ) Ate = else A^ = A + T MAX ; ]; where 

At e -circ T (t A ,t B: T MAX ). 

Thus : in FIG. 30, the high half intervals appear at the extreme left and extreme right quarters of the line or axis repre- 
senting values of linear time difference delta. In those two extreme quarters, an operation of ADD 3011 or SUBTRACT 
3021 operates on bits representing linear time difference delta, which bits are temporarily stored in a register 3031 . 
Further in FIG. 30, notations for signs and MSBs are entered for each quarter of the line. 
Here was used > while could use > for the sake of the clarity of the next section "Looking at the Sign Bits". 
[0234] The above statements replaced the values of t MAX with that of V£*T MAX . This is permissible both here as it 
would be in the quad above, since by definition t MAX < 1 /£*T MAX . Thus the inequalities hold up correctly. 
[0235] Also eliminated was the comparison with T MAX . Because of circularity all values are within the -T^x , +T MAX 
range and no comparisons are needed. 

Looking at the Sign Bits 

[0236] Looking at the single statement solution in "Closing statements, section 2" above, notice that 

• "if (A > 0)" is a test of the sign of A. 

The sign in 2-complement arithmetic, now universally adopted in DSP computers, see FIG. 29, is encoded as 
the leftmost bit. It is "0" for zero and positive values, and "1 " for the negative values. Just inside the test of the sign 
there is another test. 

• "if (a < 1 >?T MAX )" is a test of the most significant mantissa bit 

Consider that A is positive. In a 3-bit mantissa arithmetic 000, 001 , 010 and 011 (0,1 ,2 and 3) are all less then • 
half of full range, while 100, 101 : 110 and 111 (4,5,6 and 7) are greater then half of full range. Thus the decisive 
factor (Fig. 29) is the most significant bit (MSB) of value. If it is 0, the value is less than the half of T MAX . Otherwise 
it is greater. Now consider A being negative. Inside this side of the statement there is the test 

• if(A>-^T MAX ) 

Again enumerate three bit mantissas, but this time in negative numbers: 111 : 110, 101 , 100 (-1 ,-2,-3,-4) have 
the most significant bit (MSB) equal "1 ", while 011 , 01 0, 001 , 000 (-5,-6.-7,-8) that is the larger negative numbers 
have "0". Again, the decisive factor in FIGS. 29, 30 and 32 is the MSB, or most significant bit of value. 

Hardware or hardware-like solution 

[0237] In FIG. 31 , a semiconductor chip embodiment has a core microprocessor, microcontroller, or digital signal 
processor 3110 combined on a single chip with a section of nonvolatile memory 31 1 2 and sections 3113 and 31 1 5 of 
SRAM (static random access memory). The nonvolatile memory 3112 is loaded with, or manufactured to have stored 
therein, the software of FIGS. 1 , 5 and 6, and FIGS. 9 through 29, such as blocks of speech coder, packetize, VoIP 
control, IP stack, and GUI as the skilled worker selects. Further in FIG. 31 , the single-chip integrated circuit DSP 3110 
has an instruction decoder 3117, at least one ALU (arithmetic/logic unit) 3131 and a multiplier unit 3121 . Buses 3141 
inlerconnecl decoder 31 17, ALU 3131 , multiplier 3121 , and memories 3112, 3113, 3115, with a DMA and bus interface 
unit 31 51. 

[0238] In FIG. 32, the comparison A = circ T (t A , t B ) produces real values of the time intervals. In reality, sorting and 
purging processes of FIG. 13 are concerned primarily with the sign of circ T , meaning determining which of two time 
stamps t A and t B is bigger, and which is smaller. 

[0239] The sign of circj is determined from the sign of A and the next MSB bit. 

00 implies (t A > t B ) 

01 implies (t A < t B ) 

10 implies (t A > t B ) 

11 implies (t A < t Q ) 

[0240] Surprisingly, however, the outcome of the comparator-type, or sign only comparison is determined by the 
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second most significant bit, when a conventional arithmetic is used, and can be determined by uncomplicated loqic 
when other arithmetics are used. 

[0241] FIG. 32 shows a decision step or decision hardware element 321 1 . If in the register 3031 , the second most 
significant bit of A (the most significant bit of value) is 0 (zero), then At e is positive which implies that t A is arithmetically 
larger then t B and therefore t A represents a more recent event. Otherwise, t A is an earlier event then t B . 
[0242] The methods are advantageously utilized in both software and hardware embodiments 



if ((A & 0x8000) =0)... 



[0243] In the statement the second leftmost bit of the 1 6-bit A is isolated by marking it off, and compared to "0" Thus 
if (A & 0 x 8000) is "True" then t A >t B , and t A <t B otherwise. 

[0244] Further in FIG. 32, an adder/subtractor circuit 3231 is supplied with values of times t A and t B at inputs thereto 
The SIGN bit and the MSB bit from register 3031 are fed to a logic circuit 3235 which is designed by ordinary skill to 
drive an ADD/SUBTRACT control input of adder/subtractor circuit 3231 to appropriately cause an add or a subtract 
therein according to Cases 2 (two) and 4 (four) respectively when they occur. The result of adding (Case 2) or subtracting 
(Case 4) or doing nothing (Cases 1 and 3) is fed from adder/subtractor circuit 3231 to register 3031 or to memory via 
a bus 3241 . In this way circular time difference CIRCT is implemented in software or high speed hardware for a variety 
or applications. 1 

[0245] In FIG. 33, when packets are sorted by time-to-deadline (Dl) to determine which is to be processed first, then 
advantageously carry on comparisons 



At - circ T (t DDL M , t DDL x T MAX ); 

[0246] Interpreting the potential result, if At>0 (is positive) implies that the item already on the queue has longer 
deadline, and the item being sorted in should be inserted before. If At<0 the sorting process should step to the next 
item on the queue. 

[0247] The above process 3300 advantageously and efficiently "updates" the queue 1431 . Compare FIG. 33 with 
FIGS. 16 and 1 7. 

[0248] Operations of process 3300 commence at a BEGIN 3305 and initialize a Queue Record pointer at a step 3311 
before entering an updating loop. Then a step 3321 computes the circular time difference At = circ T (t DDLM t DDLX 
t max) between a record to be sorted into the queue and the time associated with a record already in the queue Next 
a decision step 3331 determines whether the circular time difference is positive. If not .operations at step 3341 step 
to the next queue record and loop back to step 3321 . Finally, the sorting loop determines that the circular time difference 
is positive, and operations to proceed to a step 3351 to insert the new record ahead of the current queue record 
thereby sorting the new record into the queue. Thereupon, a RETURN 3361 is reached. 

[0249] FIG. 34 depicts a media over packet computer system having improved packet playout control software of 
FIGS. 1, 5, 6 and 9-29 for both speech/audio and image real-time information. A media over packet control block 3411 
is interconnected with speech codec and/or audio codec 3421 , a speech/audio ingress/egress software control block 
3431 , a packetize block 3441 , depacketize block 3443, a TCP/UDP/IP stack 3451 , an image compressor/decompressor 
3471 , and an image ingress/egress control block 3473. 

[0250] A microphone and A/D circuit supply speech/audio codec 3421 with sampled audio information. Speech/audio 
codec 3421 supplies frames via speech/audio ingress/egress software control block 3431 and to packetize block 3441 
which couples to at least one software object connecting via a modem and/or link/physical layer block 3461 to a network 
or wireless communications path. Block 3461 is any kind of modem or any device that has a link layer and/or physical 
layer for communication purposes. 

[0251] Various image sources supply image data via a control interface CTRL l/F to video compressor and/or image 
compressor 3471 . The image sources include a television Tuner, a VCR video tape recorder and player, a video camera 
a CD-ROM drive having images on it, a digital still camera, the output of a medical image processing computer such 
as a CAT (computer aided tomography) scanner, PET (positron emission tomography) scanner, MRI (magnetic reso- 
nance imaging) scanner or other image processing computer (not shown). 

[0252] In an architecturally elegant and similar way to the audio blocks above, image compressor 3471 supplies 
frames via image ingress functions in image ingress/egress software control block 3473 and to packetize block 3441 
which couples to software object B connecting via the modem 3461 to the network. Real time data such as from a 
medical monitor or industrial process control (not shown) are suitably coupled analogously into the transmit path 
[0253] In the receive direction a software object B receives packets from one or more communication paths in the 
network and supplies them to depacketize block 3443 coupled to egress functions in the speech/audio ingress/egress 
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software control block 3431 . Software 3431 provides depacketized frames to audio codec 3421 for decoding of frames 
for output through D/A converter and an audio output transducer such as a loudspeaker. Packet playout control and 
lost packet compensation in software 3431 are performed as described elsewhere herein. 

[0254] In an architecturally elegant and similar way in the image path, the software object also receives image packets 
from one or more communication paths in the network and supplies them to depacketize block 3443 coupled to image 
ingress/egress control software 3473, which in turn provides image data playout control and lost packet reconstruction 
for image decompression in block 3471 for decompression of image frames. Decompressed image frames are output 
to a Display system such as television or cathode ray tube monitor, or liquid crystal display, or digital micromirror display 
or digital light processing display, video recorder, image processing equipment, storage area network (SAN), or other 
image utilization systems. 

[0255] The media over packet control 3411 is coupled to a GUI graphical user interface 3481 associated with the 
Display. The GUI 3481 is suitably controlled by an infrared or Bluetooth wireless link from a remote control source 
3483, from a wireless or wired keyboard 3485, and/or from a wearable communication and control device. 
[0256] Real time data such as from a medical monitor or industrial process control are suitably coupled from the 
network via software object B analogously into the receive path in packets coupling to a medical and/or industrial 
information processing and display. 

[0257] In gateway, wireless base station, and other applications a recoder 3491 is suitably enabled by media over 
packet control 3411. Image information decompressed by video/image codec block 3471 and audio information de- 
coded by audio codec 3421 are both coupled to the recoder 3491. Recoder 3491 then recodes or transcodes the 
information and produces an output compressed and coded according to a different form than was received by system 
3400. It is contemplated that systems such as those shown in FIGS. 1 , 3, and 4-6 as well as system 3400 of FIG. 34 
are suitably cascaded and integrated for various telecommunication and networking purposes. Where many channels 
are processed simultaneously, the systems are suitably replicated or multiplexed to the extent desired, so that software 
and hardware arc effectively, efficiently and economically employed. 

[0258] Where blocks are shown herein, they are suitably implemented in hardware, firmware or software in any 
combination. 

[0259] FIG. 35 depicts an optically accessible storage disk 3511 that has physical variations representing bits of 
information. In one embodiment the bits of information represent processor instructions such as DSP instructions for 
speech encoder 541 and ingress/egress control 581 coupled to packet software stack DSP and MCU instructions. 
Instructions in the packet software stack direct packets containing the real-time information from the sender computer 
203 by at least one path in the packet network 200 to the receiver computer 205. 

[0260] In a further storage disk 351 1 embodiment, the bits of information represent any of the operations established 
in FIGS. 1,5, 6, 9-29 and 33. 

[0261] In FIG. 36 storage 36.11 is provided by a rotatable magnetically readable hard disk storage disk 3621 bearing 
any or all of the instructions described in connection with FIG. 35. The hard disk 3621 is controlled and read by a hard 
disk drive control circuitry assembly 3631 having a read channel 3633, microcontroller or DSP 3637, and a memory 
3635 interconnected for motor control, and actuator control to read and write disk 3621 from a read write head (not 
shown). Storage 3611 is connected by an IDE, PCI or other suitable coupling 3641 to a computer printed circuit board 
or add-in card 3651 . The card 3651 has a microprocessor 3653 : memory 3655, DSP 3657 and modem 3659 intercon- 
nected to provide packets from and to a connector 3661 . 

[0262] In FIG. 37, some embodiments add memory and a control program for prestoring and playing coded speech 
to augment or even replace the speech codec in some appliances and talking toys that speak for themselves in normal 
operation or during maintenance. MCU 3731 has a VoIP control 3731 and aTCP/UDP/IP packet network protocol 
stack 3733 and an ingress/egress control block 3724 and sequence queue block 3726 coupling a speech encoder/ 
decoder 3723 to a network using the software as described elsewhere herein. Busses 3725 and 3727 couple a host 
computer 3711 to DSP 3721 and MCU 3731 executing the aforedescribed software and further couple all of them to 
a modem or Link/Physical Layer 3741, analog front end AFE to microphone and loudspeaker, and to Peripherals 
coupling to touchpad KBD and display. In this way. advantageous media over packet is accomplished in computers, 
IP phones, talking toys and home appliances such as refrigerators, microwave ovens, bread machines, blenders, coffee 
makers, laundry machines, dryers, sweepers, thermostat assemblies, light switches, lamps, fans, drape and window 
shade motor controls, surveillance equipment, traffic monitoring, clocks, radios, network cameras, televisions, digital 
telephone answering devices, air conditioners, furnaces and central air conditioning apparatus. These and other de- 
vices are suitably connected to a packet network wirelessly or via cable, telephone lines, power lines or otherwise for 
remotely located monitoring, control, user commands and maintenance. 

[0263] In FIG. 38, an embodiment advantageously addresses management of one or more gaps or holes in the 
reserves of FIG. 9 egress channel buffers. In FIG. 9 for simplicity, the reserves (shaded) were shown as a contiguous 
sequence of samples from a circular addressing point of view, even when the samples wrap around buffer boundaries 
as in FIG. 9 egress channel buffers D, E and F. 



27 



EP1 137 226 A2 



[0264] By contrast, in FIG. 38, two holes illustratively exist in the reserve in an egress channel buffer 3801 . Each 
incoming packet has a time stamp like a number in a sequence 1 ,2, 3, 5,6,7. The.number 4 is missing from the foregoing 
sequence, and represents a hole. The packet with the time stamp represented by the number 4 may arrive tardily but 
nevertheless in time for decode. Where the size of a reserve is used to express its priority for decode, an embodiment 
desirably handles reserves with holes in an intelligent manner. In one type of embodiment, the size of the reserve is 
still computed as the distance from beginning to end even if there are small holes. For example, software suitably starts 
at the smallest Dl frame in the reserve and stops the count or computation as soon as a gap of a predetermined width 
(e.g. greater than 2 frames) is encountered. For gaps of less than or equal to the predetermined width, the count 
continues. In this way, a reasonable estimate of the degree to which a channel is backing up in the buffer is obtained 
[0265] The channel record 1413 of FIG. 15 is suitably enhanced with additional entries: 

1) End of Egress Buffer deadline 

2) Hole Pointer value 

3) Switch on or off, where switch (flag) is turned on when at least one hole is present in reserve 3801 , for that 
channel. 

4) Width of hole 

5) Sequence number of missing packet (if computable) 

[0266] If plural holes occur, different embodiments suitably handle them. In one approach, only the hole having the 
most urgent deadline is tabulated in channel record 1413. In a second alternative, the two holes having the smallest 
deadline intervals Dl are tabulated in channel record 1 41 3. in a more complex embodiment, software tabulates all holes. 
[0267] FIG. 38 shows operations for filling a hole in a process which commences at a BEGIN 3805 in response to 
arrival of a new packet. Next, a decision step 3811 detects whether the Hole Switch has been turned according to a 
monitoring process as described above. If so (YES), a next step 3821 checks the sequence number of the packet 
relative to the hole pointer value. Then a decision step 3831 determines if the sequence number of the packet equals 
the hole pointer value. If so, a step 3841 fills the hole by putting the new data from the packet, suitably decoded if need 
be, into the storage area that constitutes the hole. Then a step 3851 clears the Hole Switch off, whereupon a RETURN 
3861 is reached. Note that if the Hole Switch was originally off in step 381 1 , or the packet sequence number matched 
no hole pointer value in step 3831 , then operations branch respectively from steps 381 1 and 3831 to RETURN 3861 . 
[0268] Thus, various embodiments shown and others as taught herein confer advantages on packet communications 
processes, devices and systems. Where blocks are shown herein, they are suitably implemented in hardware firmware 
or software in any combination. 



Claims 



1 . An electronic system comprising: 



a processor circuit; 

an egress packet control having stored instructions that generate for first and second received packets re- 
spective deadline intervals and order the processing in the processor circuit of the first and second received 
packets according to the respective deadline intervals; and 

a printed wiring assembly bearing the processor circuit and the egress packet control. 

2. An electronic system as claimed in claim 1 further comprising 

telephone interface circuitry having plural connectors ready for connection to plural telephone units; 
a digital network interface; and 

an integrated circuit assembly coupling the telephone interface circuitry to the digital network interface, the 
integrated circuit assembly including said printed wiring assembly and providing voice over packet transmis- 
sion and reception as a private branch exchange. 

3. An electronic system as claimed in claim 1 further comprising 

cellular telephone wireless transmit/receive interface circuitry, 
a packet network interface; and 

an integrated circuit assembly coupling the cellular telephone wireless transmit/receive interface circuitry to 
the packet network interface, the integrated circuit assembly including said printing wiring assembly and pro- 
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viding voice over packet transmission and reception as a wireless base station. 

4. An electronic system as claimed in claim 1 further comprising a single-chip integrated circuit including the processor 
circuit anc the stored instructions of the egress packet control. 

5 

5. An electronic system as claimed in claim 1 wherein the stored instructions define temporary storing of information 
about the packets on a queue in order of the respective deadline intervals. 

6. An electronic system r*.s claimed in claim 5 wherein the stored instructions further define periodic decrementing of 
10 the deadline ir.tcvais :ime passes. 

7. An electronic system ts clamed in claim 5 wherein the stored instructions further define computing for a third 
received packet a f^^c deadline interval and sorting the queue to insert information about the third received 
packet on the q.ouj m cder of its further deadline interval relative to the respective deadline intervals already on 

15 the queue 

8. An electronic sy^v*^- wia#->oo «n c.iam 5 wherein the stored instructions further define decoding a packet having 
the shortest time \o ■> .*-r r»* c ■;>'«. ssed by its deadline interval. 

20 9. An electronic & y»to»!i u^fr-oj *»- u^"* 1 wherein the stored instructions further define generation of information 
about the packer ^. *u*v of p" ^ y toys comprising deadline intervals and secondary keys comprising frame 
sizes, and tempor^'^ st -^.ng r.ictmi!.on about the packets on a queue in order of the primary keys, and for 
packets having oenu p'n,i^ keys sionng the information about the packets in order of the secondary keys. 

•25 10. An electronic system *£ cumoo in ci.ttm 1 wherein the egress packet control defines for an arriving packet the 
deadline interva ! Di as t^o d We cnco Dotwcen an arrival time A of the arriving packet and a deadline time D. 

11. An electronic systrvn a* ciat-rvvj m ruim iwherein the egress packet control defines the deadline interval Dj for 
an arriving packet > rv«vmrj * sequence number Sj and frame width F, from a deadline Di of an earlier packet i 

30 having a sequence numoof Si suOstantiaily as a function of frame width F and the difference of sequence numbers 

Sj and Si. 

12. An electronic system as ctamcd «n c aim 1 wherein an arriving silence packet j represents a number of silence 
frames S having a frame *<rn F and the egress packet control defines a deadline interval Dlj for the arriving 

35 silence packet j from a deadline interval DM previously determined for an earlier packet i, substantially as the sum 

of the deadline interval D * aided to a product of the number of silence frames S times the frame width R 



13. An electronic system as claimed ir claim 1 wherein the egress packet control has stored instructions that: 
define buffers: 

40 

compute sizes of respective information reserves in the buffers; and 

order processing of the packets according to a priority depending at least in part on the sizes of the respective 
reserves. 

45 14. An electronic system as claimed in claim 1 wherein the egress packet control has stored instructions to preempt 
processing of the first reccrved packet by preemptively processing the second received packet, when the deadline 
interval for the second reccrved packet it less than the deadline interval respective to the first received packet by 
a predetermined amount 



50 15. An electronic system as clamed in claim 1 wherein the egress packet control has stored instructions for ingress 
packet processing, and for preempting egress packet processing of an egress packet having a deadline interval 
exceeding a value, by preemptively executing ingress packet processing of at least one ingress packet. 

16. An electronic system as claimed in claim 1 having channel decoders that operate on non-coincident frame bound- 
55 aries, and wherein if the second packet has a second deadline earlier than the first deadline, the egress packet 

control has stored instructions for testing to determine whether both the second and first packets can be decoded 
ahead of their respective deadlines and if so, then preemptively executing decode of the second packet. 
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17. An electronic system as claimed in claim 1 wherein the egress packet control has stored instructions for a process 
of generating data descriptive of circular time differences between times of events A and B, the process comprising: 

electronically subtracting a value representative of the time of event B from a value representative of the time 
of event A, there resulting a most significant bit (MSB); and 

providing the MSB itself as a flag indicating which of events A and B is prior to the other. 

18. An electronic system as claimed in claim 17 wherein the stored instructions are further for: 

electronically subtracting and delivering to a storage element a value representative of the time of event B 
from a value representative of the time of event A, resulting in an electronic representation (delta) having the 
most significant bit (MSB) and a sign bit S; and 

electronically processing the electronic representation (delta) and a predetermined value (TMAX) in response 
to the MSB and the sign bit S to generate the circular time difference. 

19. An electronic system as claimed in claim 1 whereas the egress packet control has stored instructions for the 
computing for each of said received packets respective deadline intervals as circular time differences between a 
respective deadline D and a respective packet arrival time A. 

20. A wireless telephone comprising an antenna, a voice transducer, and at least one integrated circuit assembly 
coupling the voice transducer to the antenna, said at least one integrated circuit assembly providing voice over 
packet transmissions and having embedded electronic instructions comprising an ingress/egress packet control 
to process egress information and determine lowest first egress deadline interval Dl and further execute an ingress 
process preempting the egress process when the value of lowest first egress deadline interval Dl exceeds a pre- 
determined amount K. 

21. A wireless telephone comprising an antenna, a voice transducer, and at least one integrated circuit assembly 
coupling the voice transducer to the antenna, said at least one integrated circuit assembly adapted to generate 
data descriptive of circular time differences between times of events A and B by electronically subtracting a value 
representative of the time of event B from a value representative of the time of event A, there resulting a most 
significant bit (MSB); and providing the MSB itself as a flag indicating which of events A and B is prior to the other. 

22. A wireless telephone as claimed in claim 21 wherein the integrated circuit assembly is adapted to generate circular 
time differences between times of events A and B by electronically subtracting and delivering to a storage element 
a value representative of the time of event B from a value representative of the time of event A, resulting in an 
electronic representation (delta) having a most significant bit (MSB) and a sign bit S; and electronically process 
the electronic representation (delta) and a predetermined value (TMAX) in response to the MSB and the sign bit 
S to generate the circulajUime difference. 

23. A single-chip integrated circuit comprising: 

storage for values representative of the time of two events; 

an adder/subtractor coupled to the storage and operative to generate a difference value (delta) and deliver 
the difference value into said storage thereby resulting a most significant bit (MSB) of the difference value 
(delta); and 

a flag register having a bit fed with said MSB to indicating which of events A and B is prior to the other. 

24. A single-chip integrated circuit as claimed in claim 23 further having: 

logic circuitry responsive to the MSB and a sign bit S of the electronic difference (delta) and a predetermined value 
(TMAX), the logic circuitry for driving said adder/subtractor to generate the circular time difference of the two events. 

25. A method of processing first and second received packets of real-time information, 

comprising the steps of: 

computing for each of said received packets respective deadline intervals; and 

ordering processing of the first and second received packets according to the respective deadline intervals. 

26. A process of generating data descriptive of circular time differences between times of events A and B, the process 
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comprising: 

electronically subtracting a value representative of the time of event B from a value representative of the time 
of event A, there resulting a most significant bit (MSB); and 

providing the MSB itself as a flag indicating which of events A and B is prior to the other. 

27. A process of generating circular time differences as claimed in claim 26 further comprising: 

electronically delivering to a storage element a value representative of the time of event B subtracted from a 
value representative of the time of event A, resulting in an electronic representation (delta) having the . most 
significant bit (MSB) and a sign bit S; and 

electronically processing the electronic representation (delta) and a predetermined value (TMAX) in response 
to the MSB and the sign bit S to generate the circular time difference. 

28. A single chip integrated circuit comprising: 

a processor circuit; and 

an egress packet control having stored instructions that generate for first and second received packets re- 
spective deadline intervals and order the processing in the processor circuit of the first and second received 
packets according to the respective deadline intervals. 
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